LCB
Benchmarks
TaskDatasetSOTA resultTrendResults
LCB
7.81Speedup
75
LCB v6
57.1Accuracy
54
LCB v6
50.68Pass@1
48
LCB v5
61.5Accuracy
45
LCB
85.5Accuracy
29
LCB v6
53.6Accuracy
26
LCB
62.46pass@1
26
LCB V6
75.9Accuracy
21
LCB v5
37.63Score
21
LCB v5
49.5pass@1
20
LCB v6
87.7Score
20
LCB v6
84.5Score
18
LCB V2
26.9Accuracy
17
LCB
64.3AVG@8
16
LCB v6
80.2Accuracy
16
LCB v5
33.72Accuracy
16
LCB
66.41Throughput
16
LCB hard (held-out 25% eval)
33.2Utility Difference (Δπ)
13
LCB v6 (val)
78Accuracy (%)
13
LCB
8.37Speedup
12
LCB
30.1Pass@1
11
LCB 2408-2505
74.6Pass@1
11
LCB (test)
21.69Accuracy
10
LCB
59.58Score
9
LCB 128K
79.01Accuracy (%)
8