Mathematical Problem Solving on HMMT25
31Mean@32 AccuracyTeacher Model
Evaluation Results
| Method | Links | |
|---|---|---|
| Teacher ModelModel=Qwen3-4B-Instruct-2507, Teacher-Student Overlap=Large2026.06 | 31 | |
| IW-OPD10Student Model=Qwen3-4B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 25 | |
| IW-OPDStudent Model=Qwen3-4B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 25 | |
| OPDStudent Model=Qwen3-4B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 24.4 | |
| OPD10Student Model=Qwen3-4B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 23.6 | |
| IW-OPDStudent Model=Qwen3-1.7B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 15.3 | |
| OPDStudent Model=Qwen3-1.7B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 13.7 | |
| IW-OPD10Student Model=Qwen3-1.7B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 13.2 | |
| OPD10Student Model=Qwen3-1.7B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 11.3 | |
| BaseStudent Model=Qwen3-4B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 10 | |
| IW-OPDStudent Model=Qwen3-0.6B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 9.6 | |
| IW-OPD10Student Model=Qwen3-0.6B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 9.4 | |
| OPDStudent Model=Qwen3-0.6B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 7.7 | |
| OPD10Student Model=Qwen3-0.6B, Training Step=10, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 6.9 | |
| BaseStudent Model=Qwen3-1.7B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 6.8 | |
| BaseStudent Model=Qwen3-0.6B, Teacher Model=Qwen3-4B-Instruct-25072026.06 | 1.3 |