LeetCode
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
LeetCode Contest Benchmark
89.7Easy Accuracy
36
LeetCode without write access
15.2Pass@1
16
LeetCode with write access (test)
1Hack Rate
16
Leetcode-New
49.08Pass Rate
12
LeetCodeHard
38.2Accuracy
8
LeetCode (test)
2.77Error Rate (%)
7
Leetcode-Guided
48.02Pass Rate
6
Leetcode Original
38.6Pass Rate
6
LeetCode (OOD)
27.8Accuracy
5
LeetCode
93.9Quality
4
LeetCode-Contest
66.11Accuracy (%)
4
LeetCode Weekly Contests 484-488
85Pass Rate
4
LeetCode
8.47Score
3
LeetCode (test)
1.67Accuracy
3
LeetCode
87.7Quality Score
2
LeetCode
0.33Cost (cents)
2
Leetcode hard
26Hard LeetCode Accuracy
1
Leetcode medium
—Primary metric
0
Leetcode easy
—Primary metric
0