-
Foundation Models for Decision Making
A dataset for training foundation models for decision making, consisting of interactive trajectories. -
The nucleotide transformer: Building and evaluating robust foundation models ...
A foundation model for human genomics, trained on a large-scale dataset of genomic features. -
Various Datasets
The datasets used in the paper are described as follows: WikiMIA, BookMIA, Temporal Wiki, Temporal arXiv, ArXiv-1 month, Multi-Webdata, LAION-MI, Gutenberg.
