You're currently viewing an old version of this dataset. To see the current version, click here.

MBPP: A Dataset for Language Model Evaluation

The MBPP dataset is a collection of basic programming questions used to evaluate the performance of language models.

Data and Resources

This dataset has no data

Cite this as

Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde de Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman (2024). Dataset: MBPP: A Dataset for Language Model Evaluation. https://doi.org/10.57702/wdzl9567

Private DOI This DOI is not yet resolvable.
It is available for use in manuscripts, and will be published when the Dataset is made public.

Additional Info

Field	Value
Created	December 16, 2024
Last update	December 16, 2024
Defined In	https://doi.org/10.48550/arXiv.2309.02632
Author	Mark Chen
More Authors	Jerry Tworek Heewoo Jun Qiming Yuan Henrique Ponde de Oliveira Pinto Jared Kaplan Harri Edwards Yuri Burda Nicholas Joseph Greg Brockman
Homepage	https://github.com/MarkChen-95/MBPP