Code
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
57.6pass@1
8
Feb 26, 2026
10.5pass@1
7
Feb 26, 2026
68.9Pass@1
7
Feb 26, 2026
77.5pass@1
7
Feb 26, 2026
19.31Score
6
Jun 29, 2026
41.9Accuracy
6
Feb 26, 2026
60.58Accuracy
6
Feb 26, 2026
17.06Average Performance
4
May 12, 2026
48.41Avg@4
4
May 12, 2026
90.24Avg@4
4
May 12, 2026
100Pass Rate
4
Mar 20, 2026
0.215Accuracy
4
Feb 26, 2026
35.3Exact Match
4
Feb 26, 2026
36.2Exact Match
4
Feb 26, 2026
4.63Accuracy
3
May 19, 2026
1.67Accuracy
3
May 19, 2026
6.9Accuracy
3
May 19, 2026
5.17Speedup
2
Jul 9, 2026
63.39Score
2
Feb 26, 2026