ResearchDatasetsHumanEval, LiveCodeBench, and ReClorFollowBenchmarksTask NameDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyTask NameDataset NameSOTA ResultTrendResultsOut-of-domain transferHumanEval, LiveCodeBench, and ReClor average (test)65.9Out-of-domain Transfer24
Out-of-domain transferHumanEval, LiveCodeBench, and ReClor average (test)65.9Out-of-domain Transfer24