HumanEval and MBPP
Benchmarks
TaskDatasetSOTA resultTrendResults
HumanEval and MBPP
85.6Overall Average Score
78
HumanEval and MBPP EvalPlus
70.1HumanEval+ Pass@k
29
HumanEval+ and MBPP+
75HumanEval+ Score
6
HumanEval & MBPP EvalPlus (test)
39.02HumanEval Pass Rate
4