HumanEval, MBPP, APPS

The dataset used in the paper is a code generation benchmark, consisting of 164 function declarations alongside their documentation, 500 test examples, each one is an instruction for a code function, and 5k programming problems at various levels of difficulty.

Data and Resources

Cite this as

Michael Hassid, Tal Remez, Jonas Gehring, Roy Schwartz, Yossi Adi (2024). Dataset: HumanEval, MBPP, APPS. https://doi.org/10.57702/9900v52u

DOI retrieved: December 3, 2024

Additional Info

Field Value
Created December 3, 2024
Last update December 3, 2024
Defined In https://doi.org/10.48550/arXiv.2404.00725
Author Michael Hassid
More Authors
Tal Remez
Jonas Gehring
Roy Schwartz
Yossi Adi
Homepage https://arxiv.org/abs/2107.03374