Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

CodeEval dataset and benchmarks · SOTA2 Research

Research Datasets

CodeEval

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Code Generation

CodeEval-Pro BigCodeBench-Lite-Pro and HumanEval-Pro (Held-out)

79.2Average Accuracy

18

Code Generation

CodeEval-Pro BigCodeBench-Lite-Pro and HumanEval-Pro (2nd Pass)

64.6Average Accuracy

18

Code Generation

CodeEval-Pro BigCodeBench-Lite-Pro and HumanEval-Pro (1st Pass)

66.7Average Accuracy

18

Popular tasks

Code Generation

Follow for updates

Join SOTA2 Contact