Mathematical Reasoning on OlympiadBench (Pass@1, Avg)
66.91Pass@1Teacher
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TeacherBackbone=QwQ-32B, Prompting=zero-shot2026.04 | 66.91 | 73.9 | |
| MoRSDBackbone=Qwen2.5-Math-1.5B, Prompting=zero-shot2026.04 | 31.75 | 33.07 | |
| Gen-SSDBackbone=Qwen2.5-Math-1.5B, Prompting=zero-shot, Chunk size=4K2026.04 | 30.71 | 34.94 | |
| Vocabulary Dropout (gen-only)Backbone=Qwen3-8B, Vocabulary Dropout (alpha)=0.75, Phase=gen-only2026.04 | 29.2 | — | |
| Vocabulary DropoutBackbone=Qwen3-8B, Vocabulary Dropout (alpha)=0.752026.04 | 27.7 | — | |
| MCC-KDBackbone=Qwen2.5-Math-1.5B, Prompting=zero-shot2026.04 | 27.15 | 30.25 | |
| Vocabulary Dropout (train-only)Backbone=Qwen3-8B, Vocabulary Dropout (alpha)=0.75, Phase=train-only2026.04 | 27 | — | |
| Vocabulary DropoutBackbone=Qwen3-8B, Vocabulary Dropout (alpha)=0.852026.04 | 26.8 | — | |
| Vocabulary DropoutBackbone=Qwen3-4B, Vocabulary Dropout (alpha)=0.752026.04 | 24.8 | — | |
| Standard KDBackbone=Qwen2.5-Math-1.5B, Prompting=zero-shot2026.04 | 24.78 | 29.01 | |
| Vocabulary DropoutBackbone=Qwen3-4B, Vocabulary Dropout (alpha)=0.852026.04 | 24.7 | — | |
| Vocabulary Dropout (gen-only)Backbone=Qwen3-4B, Vocabulary Dropout (alpha)=0.75, Phase=gen-only2026.04 | 24.1 | — | |
| Vocabulary Dropout (train-only)Backbone=Qwen3-4B, Vocabulary Dropout (alpha)=0.75, Phase=train-only2026.04 | 23.6 | — | |
| BaselineBackbone=Qwen3-4B, Vocabulary Dropout (alpha)=1.02026.04 | 23.2 | — | |
| BaselineBackbone=Qwen3-8B, Vocabulary Dropout (alpha)=1.02026.04 | 23.1 | — | |
| Self-DistillationBackbone=Qwen2.5-Math-1.5B, Prompting=zero-shot2026.04 | 22.55 | 24.25 | |
| Base (no training)Backbone=Qwen3-4B2026.04 | 20.6 | — | |
| Base (no training)Backbone=Qwen3-8B2026.04 | 18.1 | — | |
| Cold StartBackbone=Qwen2.5-Math-1.5B, Prompting=zero-shot2026.04 | 16.17 | 18.3 | |
| StudentBackbone=Qwen2.5-Math-1.5B, Prompting=two-shot2026.04 | 15.73 | 15.54 |