Code Reasoning on MBPP (Execution Efficiency)
1Average Code LengthTarget Model
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Target ModelTarget Model=Qwen / Qwen3-8B2026.03 | 1 | 1 | 53.56 | |
| Draft ModelDraft Model=Qwen / Qwen3-0.6B-Base2026.03 | 1 | 3.56 | 14.15 | |
| OSD-LRTarget Model=Qwen / Qwen3-8B, Draft Model=Qwen / Qwen3-0.6B-Base2026.03 | 5.66 | 1.09 | 50.54 | |
| LRTarget Model=Qwen / Qwen3-8B, Draft Model=Qwen / Qwen3-0.6B-Base2026.03 | 5.76 | 1.09 | 50.65 | |
| Online-LRTarget Model=Qwen / Qwen3-8B, Draft Model=Qwen / Qwen3-0.6B-Base, framework=OnlineSPEC2026.03 | 7.16 | 1.14 | 51.19 |