Mathematical Reasoning on GSM8K, MATH500, Omni-Math, Olympiad, and AIME'24 (test)
95.2GSM8K AccuracyAM-Thinking (math)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| AM-Thinking (math)Backbone=Qwen3-8B-Base, Size=558k, Eff.=+0.0512025.12 | 95.2 | 95.6 | 64.5 | 77.5 | 65.8 | 79.7 | |
| MiroMind-M1-SFTBackbone=Qwen3-8B-Base, Size=719k, Eff.=+0.0362025.12 | 94.8 | 96.8 | 54.5 | 77 | 62.9 | 77.2 | |
| ODA-Mixture-500kBackbone=Qwen3-8B-Base, Size=506k, Eff.=+0.0512025.12 | 94.7 | 94 | 59.8 | 75.7 | 62.1 | 77.2 | |
| OmniThought-0528Backbone=Qwen3-8B-Base, Size=365k, Eff.=+0.0742025.12 | 94.2 | 95.4 | 59 | 75 | 67.9 | 78.3 | |
| SYNTHETIC-2-SFTBackbone=Qwen3-8B-Base, Size=105k, Eff.=+0.2302025.12 | 94 | 93.8 | 58.8 | 71.5 | 58.8 | 75.4 | |
| MiroMind-M1-SFTBackbone=Qwen2.5-7B-Base, Size=719k, Eff.=+0.0432025.12 | 93.9 | 91.6 | 48.1 | 66.3 | 55 | 71 | |
| Light-R1-SFTBackbone=Qwen3-8B-Base, Size=79k, Eff.=+0.2612025.12 | 93.8 | 92.6 | 48.5 | 69.7 | 54.6 | 71.8 | |
| ODA-Mixture-100kBackbone=Qwen3-8B-Base, Size=101k, Eff.=+0.2582025.12 | 93.8 | 94.2 | 61.2 | 73.3 | 64.1 | 77.3 | |
| OmniThought-0528Backbone=Qwen2.5-7B-Base, Size=365k, Eff.=+0.0862025.12 | 93.2 | 89.8 | 54.3 | 68.1 | 50.4 | 71.2 | |
| AM-Thinking (math)Backbone=Qwen2.5-7B-Base, Size=558k, Eff.=+0.0672025.12 | 92.9 | 96.2 | 60.6 | 74.2 | 63.3 | 77.4 | |
| ODA-Mixture-500kBackbone=Qwen2.5-7B-Base, Size=506k, Eff.=+0.0652025.12 | 92.9 | 92 | 52.8 | 69.7 | 56.7 | 72.8 | |
| SYNTHETIC-2-SFTBackbone=Qwen2.5-7B-Base, Size=105k, Eff.=+0.2862025.12 | 92.1 | 90 | 54.5 | 67.4 | 45 | 69.8 | |
| Qwen3-8B-BaseBackbone=Qwen3-8B-Base2025.12 | 92 | 79.6 | 30.6 | 47.2 | 6.7 | 51.2 | |
| OpenThoughts3Backbone=Qwen2.5-7B-Base, Size=1.2M, Eff.=+0.0272025.12 | 91.7 | 93.8 | 44.8 | 68.8 | 60 | 71.8 | |
| ODA-Mixture-100kBackbone=Qwen2.5-7B-Base, Size=101k, Eff.=+0.3112025.12 | 90.8 | 91 | 55.8 | 68.6 | 50 | 71.2 | |
| Qwen2.5-7B-BaseBackbone=Qwen2.5-7B-Base2025.12 | 80 | 50.2 | 26 | 35.9 | 6.7 | 39.8 |