Science Reasoning on GPQA-D
59.59Pass@1Target Model
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Target ModelDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 59.59 | 39.73 | 176.25 | |
| Target ModelDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 59.3 | 40.65 | 170.87 | |
| SemanticSpecDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 57.25 | 85.3 | 66.28 | |
| SemanticSpecDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 55.2 | 73.32 | 98.68 | |
| SpecSamplingDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 52.5 | 37.59 | 194.01 | |
| SpecSamplingDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 42.4 | 73 | 82.78 | |
| Draft ModelDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 33.8 | 371.93 | 21.3 | |
| Draft ModelDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 33.8 | 371.93 | 21.3 | |
| SpecThinkingDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 31.5 | 250.31 | 44.88 | |
| SpecReasonDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 31 | 68.83 | 109.64 | |
| SpecThinkingDraft Model=DeepseekR1-1.5B, Target Model=QwQ-32B2026.02 | 31 | 250.31 | 44.88 | |
| SpecReasonDraft Model=DeepseekR1-1.5B, Target Model=DeepseekR1-32B2026.02 | 28.1 | 52.79 | 159.33 |