General Knowledge Evaluation on General-purpose benchmarks average (test)
73.8AccuracyQwen3 8B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen3 8B2026.02 | 73.8 | 23.5 | |
| SE-KD2026.02 | 64.8 | 27.6 | |
| RS-KD2026.02 | 64.7 | 27.3 | |
| SE-KD + TopSmpselection ratio=20%2026.02 | 64.6 | 28 | |
| Full KD2026.02 | 64.4 | 27.3 | |
| SE-KD3X2026.02 | 64.4 | 27.9 | |
| TopSmpselection ratio=20%2026.02 | 64.2 | 27.8 | |
| RandomPosselection ratio=20%2026.02 | 64.1 | 27.1 | |
| TopSmp + RS-KDselection ratio=20%2026.02 | 64.1 | 27.7 | |
| RandomSmpselection ratio=20%2026.02 | 64 | 27.5 | |
| AT-KD2026.02 | 63.8 | 26.7 | |
| Qwen3 1.7B2026.02 | 61.9 | 30.5 |