Coding
Benchmarks
Dataset NameSOTA methodMetricTrendResultsLast Updated
70.2Pass@1
10
Feb 26, 2026
52.67Total Pass Rate
9
Jun 2, 2026
43Resolved Rate
9
May 11, 2026
54.8Pass@1
9
May 7, 2026
57.3Pass@1
9
May 7, 2026
74.3Pass@1
9
May 7, 2026
25.51Pass Rate
9
Jun 2, 2026
28.3Accuracy
8
Jun 9, 2026
46.7Accuracy
8
Mar 11, 2026
88.5Pass@1
8
May 26, 2026
18.8Accuracy
7
Jun 24, 2026
61.79Success Rate (SR)
7
May 12, 2026
58.9Pass@1
7
Mar 4, 2026
80.89Score
7
May 26, 2026
0.238Loss
6
Jun 15, 2026
31.43Pass@1
6
May 27, 2026
58.42Pass@1
6
May 27, 2026
49LCBv5 Score
6
May 27, 2026
40.8Pass Rate
6
May 15, 2026
24.1Accuracy
6
Apr 29, 2026
45.1Accuracy
6
Apr 29, 2026
50.6Score
6
Feb 26, 2026
25.3Pass@1
6
Feb 26, 2026
27.4Accuracy
6
Feb 26, 2026
90.8Score
5
Jun 23, 2026