General Knowledge QA on superGPQA
33.6Average AccuracyDistillable
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DistillableBase Model=Qwen3-8B2026.04 | 33.6 | 33.1 | 54.1 | |
| UndistillableBase Model=Qwen3-8B2026.04 | 32.6 | 31.7 | 53.5 | |
| TeacherBase Model=Qwen3-8B2026.04 | 32.1 | 31 | 54.6 | |
| DistillableBase Model=Gemma-3-12B2026.04 | 29.1 | 23.9 | 64 | |
| UndistillableBase Model=Gemma-3-12B2026.04 | 28.6 | 23.9 | 66.8 | |
| ImproveBase Model=Qwen3-1.7B2026.04 | 26.9 | 24.1 | 54.8 | |
| TeacherBase Model=Gemma-3-12B2026.04 | 24 | 19.4 | 56.3 | |
| GKD-RKLBase Model=Qwen3-1.7B2026.04 | 19.7 | 17.3 | 50.5 | |
| ImproveBase Model=Gemma-3-4B2026.04 | 18.3 | 14.2 | 53 | |
| GKD-FKLBase Model=Gemma-3-4B2026.04 | 18.1 | 13.1 | 54.8 | |
| GKD-FKLBase Model=Qwen3-1.7B2026.04 | 17.9 | 15.2 | 46.5 | |
| SFTBase Model=Gemma-3-4B2026.04 | 17.8 | 13.5 | 52 | |
| StudentBase Model=Gemma-3-4B2026.04 | 17.5 | 12.9 | 46.2 | |
| SFTBase Model=Qwen3-1.7B2026.04 | 17.1 | 12.3 | 52.1 | |
| GKD-RKLBase Model=Gemma-3-4B2026.04 | 16.8 | 13.2 | 45.8 | |
| StudentBase Model=Qwen3-1.7B2026.04 | 13.5 | 9 | 42.8 | |
| MisledBase Model=Gemma-3-4B2026.04 | 10.7 | 5.8 | 40.1 | |
| MisledBase Model=Qwen3-1.7B2026.04 | 5.4 | 4.5 | 38.8 |