LiveCodeBench
Benchmarks
TaskDatasetSOTA resultTrendResults
LiveCodeBench pass@1 v5
30.7pass@1
18
LiveCodeBench lite v6 (test)
56.57Accuracy
18
LiveCodeBench lite v5 (test)
64.07Accuracy
18
LiveCodeBench LCB-CPP
28.74Accuracy
17
LiveCodeBench v6 Aug 2024-May 2025 (test)
63.1Pass@1
17
LiveCodeBench v5
78.9Pass@1
17
LiveCodeBench v6
56.3Pass@1
17
LiveCodeBench
75.2Rate @32 Score
17
LiveCodeBench (LCB)
32.4% Avg@4
17
LiveCodeBench v6
0.61LCB Score
16
LiveCodeBench v6 (test)
74.8Pass@4
16
LiveCodeBench 2025.02.01-2025.05.01 v6
38.3Average Score (@16)
16
LiveCodeBench v5 (2024.08.01-2025.02.01)
44.8Average@8
16
LiveCodeBench v6
72.5Pass@1 (All)
16
LiveCodeBench
90.7Accuracy
16
LiveCodeBench v5
66pass@1
16
LiveCodeBench
81.6Best@8
16
LiveCodeBench v6 (test)
85.63Accuracy
16
LiveCodeBench v6
87.4Accuracy
15
LiveCodeBench (LCB) v5 (2410–2501) and v6 (2501–2504)
35.85Pass@1 (LCB-v5)
15
LiveCodeBench 2408 - 2505 v6
90.7Pass@1
15
LiveCodeBench
78.86Pass@1
15
LiveCodeBench
43.2Avg@16
15
LiveCodeBench v5 (test)
61.6Score
15
LiveCodeBench v5
96.8Easy Exact Match Rate
14