Mathematical Reasoning on Omni-Math (Accuracy)
78.5AccuracyConfident Decoding
Evaluation Results
| Method | Links | |
|---|---|---|
| Confident DecodingModel=Qwen3.5-122B-A10B, Decoding Method=Confident2026.06 | 78.5 | |
| Last Layer DecodingModel=Qwen3.5-122B-A10B, Decoding Method=Last Layer2026.06 | 78.3 | |
| Last Layer DecodingModel=Qwen3.5-27B, Decoding Method=Last Layer2026.06 | 76.1 | |
| Confident DecodingModel=Qwen3.5-27B, Decoding Method=Confident2026.06 | 76.1 | |
| Confident DecodingModel=Qwen3.5-35B-A3B, Decoding Method=Confident2026.06 | 72.7 | |
| Last Layer DecodingModel=Qwen3.5-35B-A3B, Decoding Method=Last Layer2026.06 | 72.6 | |
| Confident DecodingModel=gpt-oss-120B, Decoding Method=Confident2026.06 | 71 | |
| Last Layer DecodingModel=gpt-oss-120B, Decoding Method=Last Layer2026.06 | 70.2 | |
| Confident DecodingModel=Gemma-4-31B, Decoding Method=Confident2026.06 | 69 | |
| Last Layer DecodingModel=Gemma-4-31B, Decoding Method=Last Layer2026.06 | 68.3 | |
| Confident DecodingModel=gpt-oss-20b, Decoding Method=Confident2026.06 | 61.6 | |
| Last Layer DecodingModel=gpt-oss-20b, Decoding Method=Last Layer2026.06 | 60.9 | |
| Last Layer DecodingModel=Qwen3.5-9B-Base, Decoding Method=Last Layer2026.06 | 54.7 | |
| Confident DecodingModel=Qwen3.5-9B-Base, Decoding Method=Confident2026.06 | 53 | |
| Last Layer DecodingModel=Qwen3.5-9B, Decoding Method=Last Layer2026.06 | 49.1 | |
| Confident DecodingModel=Qwen3.5-9B, Decoding Method=Confident2026.06 | 47.1 | |
| Qwen2.5-7B w/ CoT Instruct (teacher)mode=CoT Instruct, role=teacher2026.05 | 36.5 | |
| GKD (online distillation)distillation_type=online2026.05 | 32 | |
| SFT w/ DISCORDdistillation_type=offline, correction=DISCORD2026.05 | 29.5 | |
| Symmetric KL w/ DISCORDdistillation_type=offline, correction=DISCORD2026.05 | 29 | |
| Qwen2.5-3B w/ CoT Instructmode=CoT Instruct2026.05 | 28.5 | |
| Symmetric KLdistillation_type=offline2026.05 | 28.5 | |
| ToDidistillation_type=offline2026.05 | 28 | |
| Qwen2.5-7Brole=reference2026.05 | 27 | |
| SFTdistillation_type=offline2026.05 | 26.5 | |
| KLdistillation_type=offline2026.05 | 26 | |
| T-MLPBackbone=LLaMA-3.1-8B-Instruct2026.05 | 18.4 | |
| T-AllBackbone=LLaMA-3.1-8B-Instruct2026.05 | 18.1 | |
| Qwen2.5-3B (base)mode=base2026.05 | 17.5 | |
| BaseBackbone=LLaMA-3.1-8B-Instruct2026.05 | 17.3 | |
| Vanilla SFTBackbone=LLaMA-3.1-8B-Instruct2026.05 | 17.1 | |
| T-AllBackbone=LLaMA-3.2-3B-Instruct2026.05 | 13.6 | |
| T-MLPBackbone=LLaMA-3.2-3B-Instruct2026.05 | 11.9 | |
| BaseBackbone=LLaMA-3.2-3B-Instruct2026.05 | 11.6 | |
| T-AllBackbone=Mistral-7B-Instruct2026.05 | 9.2 | |
| T-MLPBackbone=Mistral-7B-Instruct2026.05 | 9.1 | |
| BaseBackbone=Mistral-7B-Instruct2026.05 | 7.3 | |
| Vanilla SFTBackbone=Mistral-7B-Instruct2026.05 | 6.3 | |
| Vanilla SFTBackbone=LLaMA-3.2-3B-Instruct2026.05 | 5.2 | |
| Last Layer DecodingModel=Qwen3.5-0.8B, Decoding Method=Last Layer2026.06 | 0 | |
| Confident DecodingModel=Qwen3.5-0.8B, Decoding Method=Confident2026.06 | 0 |