-
Various Datasets
The datasets used in the paper are described as follows: WikiMIA, BookMIA, Temporal Wiki, Temporal arXiv, ArXiv-1 month, Multi-Webdata, LAION-MI, Gutenberg. -
OSCAR Dataset
The dataset used in the paper is a large corpus of real-world programs for pre-training a neural network model to learn better code representation.