You're currently viewing an old version of this dataset. To see the current version, click here.

Pile

The Pile dataset consists of 800GB text from 22 domains. Cynical selection naturally prefers text data based on the target corpus.

Data and Resources

Cite this as

L. Gao, S. Biderman, S. Black, L. Golding, T. Hoppe, C. Foster, J. Phang, H. He, A. Thite, N. Nabeshima (2025). Dataset: Pile. https://doi.org/10.57702/vo9gf0k6

DOI retrieved: January 3, 2025

Additional Info

Field Value
Created January 3, 2025
Last update January 3, 2025
Defined In https://doi.org/10.48550/arXiv.2210.10951
Citation
  • https://doi.org/10.48550/arXiv.2312.03788
Author L. Gao
More Authors
S. Biderman
S. Black
L. Golding
T. Hoppe
C. Foster
J. Phang
H. He
A. Thite
N. Nabeshima
Homepage https://github.com/jsedoc/DL-CynDS