Code Generation on LiveCodeBench v6 (Accuracy, Latency, Steps, Ratio)
37.14AccuracyLRM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LRMModel Backbone=DeepSeek-R1 (1.5B/32B)2026.04 | 37.14 | 409 | 234 | 23.2 | |
| SpecReasonModel Backbone=DeepSeek-R1 (1.5B/32B)2026.04 | 36 | 536 | 239 | 23.17 | |
| RankGuideModel Backbone=DeepSeek-R1 (1.5B/32B)2026.04 | 35.43 | 347 | 196 | 21.02 | |
| GlimpRouterModel Backbone=DeepSeek-R1 (1.5B/32B)2026.04 | 33.14 | 342 | 236 | 26.3 | |
| SRMModel Backbone=DeepSeek-R1 (1.5B/32B)2026.04 | 18.29 | 141 | 222 | 36.5 |