OpenWebText Corpus

A dataset for language modeling, where the goal is to predict the next word in a sequence given the previous words.

Data and Resources

Original MetadataJSON
The json representation of the dataset with its distributions based on DCAT.
Explore
- Preview
- Download

Subham Sekhar Sahoo, Aaron Gokaslan, Chris De Sa, Volodymyr Kuleshov (2024). Dataset: OpenWebText Corpus. https://doi.org/10.57702/yw8o2eqh

DOI retrieved: December 2, 2024

Field	Value
Created	December 2, 2024
Last update	December 2, 2024
Defined In	https://doi.org/10.48550/arXiv.2406.07524
Citation	https://doi.org/10.48550/arXiv.2202.04538
Author	Subham Sekhar Sahoo
More Authors	Aaron Gokaslan Chris De Sa Volodymyr Kuleshov
Homepage	https://Skylion007.github.io/OpenWebTextCorpus