Mathematical Reasoning on SAT-Math (Pass@1)
100Pass@1MT
Evaluation Results
| Method | Links | |
|---|---|---|
| MTTeacher Model=Qwen2-Math-7B-Instruct2026.04 | 100 | |
| MSStudent Model=Qwen2-Math-1.5B2026.04 | 81.2 | |
| VCRDTeacher Model=Qwen2-Math-7B-Instruct, Student Model=Qwen2-Math-1.5B2026.04 | 81.2 | |
| GKDTeacher Model=Qwen2-Math-7B-Instruct, Student Model=Qwen2-Math-1.5B2026.04 | 78.1 | |
| DistilLLMTeacher Model=Qwen2-Math-7B-Instruct, Student Model=Qwen2-Math-1.5B2026.04 | 68.8 | |
| DistillLM-2Teacher Model=Qwen2-Math-7B-Instruct, Student Model=Qwen2-Math-1.5B2026.04 | 65.6 | |
| ABKDTeacher Model=Qwen2-Math-7B-Instruct, Student Model=Qwen2-Math-1.5B2026.04 | 43.8 | |
| KDTeacher Model=Qwen2-Math-7B-Instruct, Student Model=Qwen2-Math-1.5B2026.04 | 40.6 |