You're currently viewing an old version of this dataset. To see the current version, click here.
SlimPajama: A 627B token cleaned and deduplicated version of RedPajama
Data and Resources
This dataset has no data
Cite this as
Daria Soboleva, Faisal Al-Khateeb, Robert Myers, Jacob R Steeves, Joel Hestness (2025). Dataset: SlimPajama: A 627B token cleaned and deduplicated version of RedPajama. https://doi.org/10.57702/5qhh9qg6
Private DOI This DOI is not yet resolvable.It is available for use in manuscripts, and will be published when the Dataset is made public.
Additional Info
| Field | Value |
|---|---|
| Created | January 2, 2025 |
| Last update | January 2, 2025 |
| Defined In | https://doi.org/10.48550/arXiv.2403.08763 |
| Author | Daria Soboleva |
| More Authors |
|
| Homepage | https://huggingface.co/datasets/cerebras/SlimPajama-627B |