You're currently viewing an old version of this dataset. To see the current version, click here.

HumanEval, MBPP, APPS

The dataset used in the paper is a code generation benchmark, consisting of 164 function declarations alongside their documentation, 500 test examples, each one is an instruction for a code function, and 5k programming problems at various levels of difficulty.

Data and Resources

This dataset has no data

Cite this as

Michael Hassid, Tal Remez, Jonas Gehring, Roy Schwartz, Yossi Adi (2024). Dataset: HumanEval, MBPP, APPS. https://doi.org/10.57702/9900v52u

Private DOI This DOI is not yet resolvable.
It is available for use in manuscripts, and will be published when the Dataset is made public.

Additional Info

Field	Value
Created	December 3, 2024
Last update	December 3, 2024
Defined In	https://doi.org/10.48550/arXiv.2404.00725
Author	Michael Hassid
More Authors	Tal Remez Jonas Gehring Roy Schwartz Yossi Adi
Homepage	https://arxiv.org/abs/2107.03374