Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Code Generation research benchmarks – Page 12 · SOTA2 Research

Code Generation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Code Category Average (test)

77.43Accuracy

18

Mar 9, 2026

2.3Speed

18

Feb 26, 2026

2.4Speed (Spd)

18

Feb 26, 2026

41.44pass@1

18

Feb 26, 2026

73.33Pass@1

18

Feb 26, 2026

90.9Pass@1

18

Mar 5, 2026

LiveCodeBench v6, LiveCodeBench-ko, HumanEval+, HumanEval+ ko, MBPP+, SciCode

0.992Pass@1

18

Feb 26, 2026

LiveCodeBench pass@1 v5

Qwen2.5-Coder-32B-Instruct

30.7pass@1

18

Feb 26, 2026

Code Domain HumanEval, HumanEval+, MBPP, MBPP+, Bigcode (test)

48.2HumanEval

18

Feb 26, 2026

32.93Tokens/s

18

Feb 26, 2026

OJBench ICPC 2025 (test)

19.18Accuracy

18

Feb 26, 2026

LiveCodeBench lite v6 (test)

Gemini-2.5-flash

56.57Accuracy

18

Feb 26, 2026

LiveCodeBench lite v5 (test)

Gemini-2.5-flash

64.07Accuracy

18

Feb 26, 2026

MBPP 2021 (test)

94.94Accuracy

18

Apr 14, 2026

21.38PR

18

Feb 27, 2026

MBPP sample 200

79.5Pass@1

18

Feb 26, 2026

MBPP subset of 500 (test)

64.6Pass@1

18

Feb 26, 2026

LiveCodeBench LCB-CPP

Nemotron-Labs-Diffusion-14B

28.74Accuracy

17

Jul 8, 2026

87.3Pass@1

17

Jul 8, 2026

Nemotron-Labs-Diffusion-14B

87.2Pass@1

17

Jul 8, 2026

LiveCodeBench v6 Aug 2024-May 2025 (test)

63.1Pass@1

17

Jul 3, 2026

LiveCodeBench v5

78.9Pass@1

17

Jul 3, 2026

90% (CodeEnhance-gemma-4b+CodeQA) + 10% Raw

65MB Score

17

Jun 11, 2026

95% (CodeEnhance-gemma-4b+CodeQA) + 5% Raw

48.7HumanEval Score

17

Jun 11, 2026

26.9Accuracy

17

Jun 9, 2026

Page 12 of 40

Popular datasets

HumanEval MBPP LiveCodeBench BigCodeBench LCB

Follow for updates

Join SOTA2 Contact