Mathematical Reasoning on Gaokao (Pass@1)
66.5Pass@1MT
Evaluation Results
| Method | Links | |
|---|---|---|
| MTTeacher Model=Qwen2.5-Math-7B-Instruct2026.04 | 66.5 | |
| KDTeacher Model=Qwen2.5-Math-7B-Instruct, Student Model=Qwen2.5-Math-1.5B2026.04 | 62.9 | |
| VCRDTeacher Model=Qwen2.5-Math-7B-Instruct, Student Model=Qwen2.5-Math-1.5B2026.04 | 62.1 | |
| ABKDTeacher Model=Qwen2.5-Math-7B-Instruct, Student Model=Qwen2.5-Math-1.5B2026.04 | 61.8 | |
| DistillLM-2Teacher Model=Qwen2.5-Math-7B-Instruct, Student Model=Qwen2.5-Math-1.5B2026.04 | 61.6 | |
| DistilLLMTeacher Model=Qwen2.5-Math-7B-Instruct, Student Model=Qwen2.5-Math-1.5B2026.04 | 60.3 | |
| GKDTeacher Model=Qwen2.5-Math-7B-Instruct, Student Model=Qwen2.5-Math-1.5B2026.04 | 60 | |
| MSStudent Model=Qwen2.5-Math-1.5B2026.04 | 42.1 |