Instruction Following on IFEval (Average Metric)
47.67Average ScoreMOTAB
Evaluation Results
| Method | Links | |
|---|---|---|
| MOTABStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.05 | 47.67 | |
| MOTABStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.05 | 46.8 | |
| SKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B, beta=0.62026.05 | 44.36 | |
| SKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B, beta=0.82026.05 | 44.36 | |
| SKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B, beta=1.02026.05 | 44.19 | |
| SFTStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.05 | 43.38 | |
| ImitKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.05 | 43.35 | |
| ImitKDStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.05 | 43.31 | |
| SFTStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.05 | 42.3 | |
| SKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B, beta=0.82026.05 | 41.65 | |
| SKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B, beta=0.62026.05 | 41.57 | |
| RFTStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B2026.05 | 41.16 | |
| RFTStudent LLM=Qwen3-1.7B, Teacher Model=Qwen3-32B2026.05 | 41.02 | |
| SKDStudent LLM=Llama3.2-3B-Instruct, Teacher Model=Qwen3-32B, beta=1.02026.05 | 39.79 | |
| MOTABStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.05 | 37.61 | |
| SKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B, beta=0.62026.05 | 36.18 | |
| ImitKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.05 | 35.32 | |
| SFTStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.05 | 34.78 | |
| SKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B, beta=1.02026.05 | 34.63 | |
| RFTStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B2026.05 | 34.27 | |
| SKDStudent LLM=Qwen2.5-7B-Instruct, Teacher Model=Qwen3-32B, beta=0.82026.05 | 33.85 |