Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Code Generation research benchmarks – Page 35 · SOTA2 Research

Code Generation

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

94.51Pass@3

4

Mar 24, 2026

Truck CAN signal (Total)

GPT-4o + DomRetriever

98.04pass@1

4

Mar 24, 2026

Truck CAN signal (Dynamics)

GPT-4o + DomRetriever

96.4Pass@1

4

Mar 24, 2026

Truck CAN signal Visibility

GPT-4o + DomRetriever

100pass@1

4

Mar 24, 2026

Truck CAN signal (Vehicle system)

GPT-4o + DomRetriever

97.1pass@1

4

Mar 24, 2026

Truck CAN signal Energy

GPT-4o + DomRetriever

100pass@1

4

Mar 24, 2026

Truck CAN signal Connected systems

97.8Pass@1

4

Mar 24, 2026

Truck CAN signal Driver productivity

GPT-4o + DomRetriever

100pass@1

4

Mar 24, 2026

53.7Pass@1

4

Mar 17, 2026

100Success Rate (SR)

4

Mar 10, 2026

54.6MBPP Score

4

Mar 6, 2026

Code Benchmarks Total

26.4Avg@8

4

Feb 26, 2026

33.7Avg@8

4

Feb 26, 2026

17.9Avg@8

4

Feb 26, 2026

9.76Throughput (tokens/s)

4

Feb 26, 2026

LeetCode Weekly Contests 484-488

85Pass Rate

4

Feb 26, 2026

10.57Accuracy

4

Feb 26, 2026

99F1 Score

4

Feb 26, 2026

Coding Tasks Suite HumanEval, MBPP, HumanEval+, MBPP+, CRUX-O

71.95HumanEval Score

4

Feb 26, 2026

Multiple Adaptations (Random)

60.65Pass@1

4

Feb 26, 2026

25.19Pass@1

4

Feb 26, 2026

Text2Java (test)

83.75ASRs

4

Feb 26, 2026

MathQA Python Original (test)

84.7Pass@80

4

Feb 26, 2026

76.83pass@10

3

Jul 3, 2026

60.4Pass@10

3

Jul 3, 2026

Page 35 of 40

Popular datasets

HumanEval MBPP LiveCodeBench BigCodeBench LCB

Follow for updates

Join SOTA2 Contact