ResearchDatasetsHumanEval, LiveCodeBench, and ReClorHumanEval, LiveCodeBench, and ReClorFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsOut-of-domain transferHumanEval, LiveCodeBench, and ReClor average (test)65.9Out-of-domain Transfer24
Out-of-domain transferHumanEval, LiveCodeBench, and ReClor average (test)65.9Out-of-domain Transfer24