Mathematical Reasoning on MATH 500 (L1-L5 Scores)
90.7L1 ScoreSFT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SFTStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.05 | 90.7 | 84.44 | 73.33 | 67.97 | 43.28 | |
| SKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B, beta=0.62026.05 | 90.7 | 83.33 | 77.14 | 66.41 | 45.52 | |
| MOTABStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.05 | 90.7 | 93.33 | 82.86 | 78.91 | 58.21 | |
| MOTABStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.05 | 90.7 | 84.44 | 81.9 | 67.19 | 48.51 | |
| SKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B, beta=0.82026.05 | 88.37 | 85.56 | 76.19 | 68.75 | 44.03 | |
| SKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B, beta=0.82026.05 | 88.37 | 63.33 | 59.05 | 50 | 23.88 | |
| RFTStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.05 | 88.37 | 82.22 | 80.95 | 58.59 | 35.07 | |
| SKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B, beta=0.82026.05 | 88.37 | 81.11 | 73.33 | 69.53 | 35.07 | |
| SKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B, beta=1.02026.05 | 86.05 | 76.67 | 69.52 | 60.16 | 41.04 | |
| MOTABStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.05 | 86.05 | 68.89 | 60.95 | 48.44 | 28.36 | |
| SKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B, beta=1.02026.05 | 86.05 | 77.78 | 72.38 | 64.06 | 41.79 | |
| SKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B, beta=1.02026.05 | 83.72 | 58.89 | 52.38 | 34.38 | 17.91 | |
| SFTStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.05 | 83.72 | 74.44 | 69.52 | 60.16 | 44.78 | |
| SKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B, beta=0.62026.05 | 83.72 | 83.33 | 75.24 | 65.62 | 33.58 | |
| RFTStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.05 | 81.4 | 75.56 | 74.29 | 66.41 | 41.04 | |
| ImitKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.05 | 81.4 | 80 | 80 | 59.38 | 48.51 | |
| SFTStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.05 | 79.07 | 53.33 | 51.43 | 42.19 | 22.39 | |
| ImitKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.05 | 76.74 | 66.67 | 57.14 | 40.62 | 17.91 | |
| SKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B, beta=0.62026.05 | 76.64 | 68.89 | 58.1 | 42.97 | 15.67 | |
| RFTStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.05 | 74.42 | 58.89 | 59.05 | 42.19 | 20.9 | |
| ImitKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.05 | 74.42 | 70 | 72.38 | 57.81 | 35.82 |