Penn Treebank and Wikipedia-90M

The Penn Treebank dataset is used for sentence-level language modeling, and the 90 million word subset of Wikipedia is used for paraphrasing.

Data and Resources

Cite this as

Xinyuan Zhang, Yi Yang, Siyang Yuan, Dinghan Shen, Lawrence Carin (2024). Dataset: Penn Treebank and Wikipedia-90M. https://doi.org/10.57702/1r47dycw

DOI retrieved: December 2, 2024

Additional Info

Field Value
Created December 2, 2024
Last update December 2, 2024
Defined In https://doi.org/10.48550/arXiv.1906.02181
Author Xinyuan Zhang
More Authors
Yi Yang
Siyang Yuan
Dinghan Shen
Lawrence Carin
Homepage https://www.aclweb.org/anthology/D18-1234