SlimPajama: A 627B token cleaned and deduplicated version of RedPajama
Data and Resources
-
Original MetadataJSON
The json representation of the dataset with its distributions based on DCAT.
Cite this as
Daria Soboleva, Faisal Al-Khateeb, Robert Myers, Jacob R Steeves, Joel Hestness (2025). Dataset: SlimPajama: A 627B token cleaned and deduplicated version of RedPajama. https://doi.org/10.57702/5qhh9qg6
DOI retrieved: January 2, 2025
Additional Info
| Field | Value |
|---|---|
| Created | January 2, 2025 |
| Last update | January 2, 2025 |
| Defined In | https://doi.org/10.48550/arXiv.2403.08763 |
| Author | Daria Soboleva |
| More Authors |
|
| Homepage | https://huggingface.co/datasets/cerebras/SlimPajama-627B |