9 datasets found

The Pile dataset contains 3.5 million samples of diverse text for language modeling.

The TMC dataset is a collection of air traffic reports.

The problem of similarity search is to find the most similar items in a large collection to a query item of interest. Fast similarity search is at the core of many information...

The CNAE-9 dataset is a set of 9 categories from the National Classification of Economic Activities.

The paper presents the PeerRead dataset for testing the sparse deep generative model.

CommonCrawl is a non-profit organization that provides a large corpus of web pages for research and development purposes.

The dataset used in the paper to train the Toolformer model.

The OSCAR corpus is a multilingual web corpus that is used for pre-training large generative language models. It is a document-oriented corpus that is comparable in size and...

The Common Crawl (CC) project browses and indexes all content available online. It generates 200-300 TiB of data per month (around 5% of which is in French), and constitutes the...