Mathematical Reasoning on AIME 2024 1
30AccuracyTA-OPD
Evaluation Results
| Method | Links | |
|---|---|---|
| TA-OPDSetting=Qwen3-8B (GRPO) -> Qwen3-4B, Supervised-token budget=10%2026.05 | 30 | |
| TA-OPD+Ent.Setting=Qwen3-8B (GRPO) -> Qwen3-4B, Supervised-token budget=10%2026.05 | 30 | |
| EntropySetting=Qwen3-8B (GRPO) -> Qwen3-4B, Supervised-token budget=10%2026.05 | 26.33 | |
| TIPSetting=Qwen3-8B (GRPO) -> Qwen3-4B, Supervised-token budget=10%2026.05 | 26.33 | |
| Pure OPDSetting=Qwen3-14B -> Qwen3-4B, Supervised-token budget=10%2026.05 | 23.34 | |
| TA-OPDSetting=Qwen3-14B -> Qwen3-4B, Supervised-token budget=10%2026.05 | 23.34 | |
| EntropySetting=Qwen3-14B -> Qwen3-4B, Supervised-token budget=10%2026.05 | 21.67 | |
| TA-OPD+Ent.Setting=Qwen3-14B -> Qwen3-4B, Supervised-token budget=10%2026.05 | 21.67 | |
| BaseSetting=Qwen3-8B (GRPO) -> Qwen3-4B, Supervised-token budget=10%2026.05 | 21.66 | |
| BaseSetting=Qwen3-14B -> Qwen3-4B, Supervised-token budget=10%2026.05 | 21.66 | |
| TA-OPDSetting=Qwen3-4B -> Qwen3-1.7B, Supervised-token budget=10%2026.05 | 20 | |
| Pure OPDSetting=Qwen3-8B (GRPO) -> Qwen3-4B, Supervised-token budget=10%2026.05 | 20 | |
| TIPSetting=Qwen3-14B -> Qwen3-4B, Supervised-token budget=10%2026.05 | 20 | |
| TIPSetting=Qwen3-4B -> Qwen3-1.7B, Supervised-token budget=10%2026.05 | 18.34 | |
| TA-OPD+Ent.Setting=Qwen3-4B -> Qwen3-1.7B, Supervised-token budget=10%2026.05 | 15 | |
| EntropySetting=Qwen3-4B -> Qwen3-1.7B, Supervised-token budget=10%2026.05 | 13.34 | |
| Pure OPDSetting=Qwen3-4B -> Qwen3-1.7B, Supervised-token budget=10%2026.05 | 11.67 | |
| BaseSetting=Qwen3-4B -> Qwen3-1.7B, Supervised-token budget=10%2026.05 | 10 | |
| TA-OPD+Ent.Setting=DeepSeek-R1-Distill-Qwen-14B -> Qwen2.5-3B, Supervised-token budget=10%2026.05 | 8.34 | |
| Pure OPDSetting=DeepSeek-R1-Distill-Qwen-14B -> Qwen2.5-3B, Supervised-token budget=10%2026.05 | 5 | |
| TA-OPDSetting=DeepSeek-R1-Distill-Qwen-14B -> Qwen2.5-3B, Supervised-token budget=10%2026.05 | 5 | |
| BaseSetting=DeepSeek-R1-Distill-Qwen-14B -> Qwen2.5-3B, Supervised-token budget=10%2026.05 | 3.34 | |
| TIPSetting=DeepSeek-R1-Distill-Qwen-14B -> Qwen2.5-3B, Supervised-token budget=10%2026.05 | 3.33 | |
| EntropySetting=DeepSeek-R1-Distill-Qwen-14B -> Qwen2.5-3B, Supervised-token budget=10%2026.05 | 1.67 |