You're currently viewing an old version of this dataset. To see the current version, click here.

Pile

The Pile dataset consists of 800GB text from 22 domains. Cynical selection naturally prefers text data based on the target corpus.

Data and Resources

This dataset has no data

Cite this as

L. Gao, S. Biderman, S. Black, L. Golding, T. Hoppe, C. Foster, J. Phang, H. He, A. Thite, N. Nabeshima (2025). Dataset: Pile. https://doi.org/10.57702/vo9gf0k6

Private DOI This DOI is not yet resolvable.
It is available for use in manuscripts, and will be published when the Dataset is made public.

Additional Info

Field Value
Created January 3, 2025
Last update January 3, 2025
Defined In https://doi.org/10.48550/arXiv.2210.10951
Citation
  • https://doi.org/10.48550/arXiv.2312.03788
Author L. Gao
More Authors
S. Biderman
S. Black
L. Golding
T. Hoppe
C. Foster
J. Phang
H. He
A. Thite
N. Nabeshima
Homepage https://github.com/jsedoc/DL-CynDS