3 datasets found

Groups: Text Data

Filter Results

  • The Pile

    The Pile dataset contains 3.5 million samples of diverse text for language modeling.

  • OSCAR

    The OSCAR corpus is a multilingual web corpus that is used for pre-training large generative language models. It is a document-oriented corpus that is comparable in size and...

  • Common Crawl

    The Common Crawl (CC) project browses and indexes all content available online. It generates 200-300 TiB of data per month (around 5% of which is in French), and constitutes the...