LCB
Benchmarks
TaskDatasetSOTA resultTrendResults
LCB v6
93.28Avg@4
8
LCB-Hard (171)
62.6Accuracy
8
LCB v6
7.7Pass@1
8
LCB-IO
81.7Pass@1
8
LCB Pro Med 25Q2
10.5pass@1
7
LCB 08/24-02/25 v5
77.5pass@1
7
LCB v6
31.43Pass@1
6
LCB v5
58.42Pass@1
6
LCB v6 (fixed 500-problem slice)
53.5Pass@4
6
LCBv5 LCBv6 (test)
49LCBv5 Score
6
LCB v5
42.1Pass@1
6
LCB monolingual
96.44RPR
5
LCB cross-lingual
58.28RPR
5
LCB monolingual
99.9RPR
5
LCB cross-lingual
97.68RPR
5
LCB v6
42.18Accuracy
5
LCB v5 (evaluation)
19.93Pass@1
5
LCB Hard
91.1PRR
4
LCB Medium
84.2PRR
4
LCB
41.4LCB Score
4
LCB
2.8Accuracy
3
LCB
53.4Avg@4
3
LCB-Pro-Dafny
56.4Verification Success Rate
2
LCB-Pro-Dafny Hard
28Verification Success Rate
2
LCB
48Winrate
1