Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Code Generation research benchmarks – Page 30 · SOTA2 Research

Code Generation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

Leetcode-Guided

48.02Pass Rate

6

Feb 26, 2026

Leetcode Original

38.6Pass Rate

6

Feb 26, 2026

MBPP Hard-Guided

72.44Pass Rate

6

Feb 26, 2026

77.19Pass Rate

6

Feb 26, 2026

41Pass@1

6

Feb 26, 2026

59.5Last Epoch Success Rate

6

Feb 26, 2026

BigCodeBench (val)

50.8Success Rate

6

Feb 26, 2026

0.459Accuracy

6

Feb 26, 2026

LiveCodeBench v6

64.6pass@5

6

Feb 26, 2026

89Score

6

Feb 26, 2026

4B Iterative (Lower Bound)

0.37Cost

6

Feb 26, 2026

LiveCodeBench v5 (880 samples)

4B Iterative (Lower Bound)

0.46Cost

6

Feb 26, 2026

35.2Pass@5

6

Feb 26, 2026

46.5English Overall Pass@1

6

Feb 26, 2026

CSN Python (test)

35.1ROUGE-1 F1

6

Feb 26, 2026

Python dataset (test)

16.66BLEU

6

Feb 26, 2026

Java dataset (test)

27.53BLEU

6

Feb 26, 2026

Energy-Aware Code Generation (Held-out problems)

Energy-SFT + EDP

63.5Train Success Rate

5

Jul 7, 2026

62.65Accuracy

5

Jul 7, 2026

60.37Accuracy

5

Jul 7, 2026

LiveCodeBench (LCB)

92.88LCB Accuracy (Easy)

5

Jun 30, 2026

Wave-4 Wave-8 Qwen-2.5-7B (test)

22.2Achieved

5

Jun 23, 2026

Python 10 sequential 20-step campaigns (end-of-chain)

Qwen2.5-7B + Best-ckpt oracle (peak-ckpt, no gate)

25.9End pass@1

5

Jun 23, 2026

45.38Accuracy

5

Jun 17, 2026

87.7MTP Acceptance Rate

5

Jun 11, 2026

Page 30 of 40

Popular datasets

HumanEval MBPP LiveCodeBench BigCodeBench LCB

Follow for updates

Join SOTA2 Contact