Coding
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
67.16Pass Rate
3
May 14, 2026
26.1Pass Rate
3
Apr 16, 2026
63.3Pass Rate
3
Apr 16, 2026
89Pass Rate
3
Apr 16, 2026
88Pass@1
3
Apr 15, 2026
42.6Accuracy
3
Apr 6, 2026
2.8Accuracy
3
Mar 4, 2026
31.94Accuracy
3
Feb 26, 2026
97.1Quality Score
2
Jun 26, 2026
99Quality Score
2
Jun 26, 2026
97Quality
2
Jun 26, 2026
99.3Quality (%)
2
Jun 26, 2026
99.5Quality
2
Jun 26, 2026
87.7Quality Score
2
Jun 26, 2026
49.1Quality Score (%)
2
Jun 26, 2026
86.8Quality
2
Jun 26, 2026
73.39Pass@1
2
Jun 2, 2026
30.6F1 Score
2
Feb 26, 2026
36.67Baseline Score
1
Apr 10, 2026
31.96Baseline Score
1
Apr 10, 2026
51.14Baseline
1
Apr 10, 2026