General Language Understanding on Held-out capability suite (test)
62.9AIME-2024 AccuracyBase
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| BaseBackbone=Qwen3-4B-It2026.05 | 62.9 | 94.2 | 92.6 | 86 | 77.6 | 82.6 | |
| MIXSDBackbone=Qwen3-4B-It, lambda=0.52026.05 | 44.8 | 93 | 91.7 | 87.2 | 61 | 75.5 | |
| MIXSDBackbone=Qwen3-4B-It, lambda=0.32026.05 | 41.5 | 84.8 | 87.2 | 83.5 | 53.7 | 70.1 | |
| BaseBackbone=Qwen3-8B2026.05 | 26 | 83.4 | 91.8 | 86.6 | 73.1 | 72.2 | |
| MIXSDBackbone=Qwen3-8B, lambda=0.52026.05 | 24.2 | 82 | 91.4 | 81.1 | 71 | 69.9 | |
| MIXSDBackbone=Qwen3-4B-It, lambda=02026.05 | 23.5 | 80.8 | 88 | 84.8 | 65.5 | 68.5 | |
| MIXSDBackbone=Qwen3-8B, lambda=0.32026.05 | 22.5 | 77.6 | 91.4 | 79.3 | 67.4 | 67.6 | |
| BaseBackbone=Qwen3-1.7B2026.05 | 11 | 72.4 | 80.4 | 60.4 | 58.5 | 56.5 | |
| MIXSDBackbone=Qwen3-8B, lambda=02026.05 | 10.6 | 69.8 | 89.2 | 61 | 67.3 | 59.6 | |
| SFTBackbone=Qwen3-8B2026.05 | 7.7 | 34.4 | 25.4 | 83.5 | 69.9 | 44.2 | |
| SFTBackbone=Qwen3-4B-It2026.05 | 5.2 | 30 | 22.7 | 81.1 | 56.9 | 39.2 | |
| MIXSDBackbone=Qwen3-1.7B, lambda=0.52026.05 | 0.6 | 26.8 | 32.1 | 20.7 | 23.5 | 20.7 | |
| MIXSDBackbone=Qwen3-1.7B, lambda=0.32026.05 | 0.2 | 13.6 | 13.2 | 4.9 | 24.6 | 11.3 | |
| SFTBackbone=Qwen3-1.7B2026.05 | 0 | 1.8 | 0.4 | 0 | 0.4 | 0.5 | |
| OPSDBackbone=Qwen3-1.7B2026.05 | 0 | 1.8 | 0.8 | 0.6 | 4.4 | 1.5 | |
| MIXSDBackbone=Qwen3-1.7B, lambda=02026.05 | 0 | 5.2 | 3 | 0 | 9.4 | 3.5 |