Software Engineering Skill Evaluation
Benchmarks
DatasetSOTA methodMetricTrendResultsLast updated
60Pass Rate (out of 10)
3
Jun 16, 2026
4Pass Rate
3
Jun 16, 2026
30Pass Rate
3
Jun 16, 2026
60Pass Rate
3
Jun 16, 2026
0Pass Rate
3
Jun 16, 2026
10Pass Rate
3
Jun 16, 2026
30Pass Rate
3
Jun 16, 2026
0Pass Rate
3
Jun 16, 2026
50Pass Rate
3
Jun 16, 2026
2Pass Rate
3
Jun 16, 2026
7Pass Count
3
Jun 16, 2026
30Pass Rate
3
Jun 16, 2026
7Pass Rate
3
Jun 16, 2026
0Pass Rate
3
Jun 16, 2026
8Pass Rate
3
Jun 16, 2026
4Pass Rate
3
Jun 16, 2026
40Pass Rate
3
Jun 16, 2026
0Pass Rate
3
Jun 16, 2026
30Pass Rate
3
Jun 16, 2026
7Pass Rate
3
Jun 16, 2026
5Pass Rate
3
Jun 16, 2026
65Pass Rate
3
Jun 16, 2026