Chain-of-Thought Reasoning on Reasoning Dataset
86.9Accuracy (Acc)Qwen3-30B-A3B-Thinking-2507
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen3-30B-A3B-Thinking-2507Model Category=Open-Source Models2026.03 | 86.9 | 5,077.3 | 93.1 | 0.019 | 145.7 | 1.656 | 5.67 | 5.34 | 11.4 | 13.2 | 12 | 68.8 | 68.4 | |
| Qwen3-235B-A22B-Thinking-2507Model Category=Open-Source Models2026.03 | 86.8 | 5,823 | 117.4 | 0.02 | 178.4 | 1.6 | 5.53 | 5.23 | 10 | 12.9 | 12.3 | 69.3 | 60.8 | |
| Doubao-Seed-1.6Model Category=Proprietary Models2026.03 | 85.5 | 1,462.3 | 26 | 0.003 | 41.7 | 1.661 | 3.72 | 3.54 | 10.2 | 7.4 | 9.6 | 50.2 | 17.1 | |
| Qwen3-MaxModel Category=Proprietary Models2026.03 | 85.3 | 6,954.8 | 181.2 | 0.105 | 265 | 1.617 | 1.59 | 1.64 | 15 | 12.3 | 46.8 | 86.5 | 95.5 | |
| DeepSeek-V3.2Model Category=Open-Source Models2026.03 | 83.2 | 1,794.3 | 45.9 | 0.068 | 63.9 | 1.484 | 3.1 | 2.95 | 9.8 | 7.5 | 10.3 | 58 | 38.2 | |
| DeepSeek-R1Model Category=Open-Source Models2026.03 | 82.8 | 4,313.4 | 149.8 | 0.03 | 233 | 1.749 | 6.84 | 6.7 | 11.2 | 7 | 12.4 | 78 | 63.6 | |
| gpt-oss-120bModel Category=Open-Source Models2026.03 | 82.4 | 1,080.1 | 21.5 | 0.033 | 28.2 | 1.331 | 2.65 | 2.51 | 8.8 | 4.4 | 9.1 | 33.6 | 16.4 | |
| GLM-4.6Model Category=Open-Source Models2026.03 | 82.1 | 2,673.6 | 61.8 | 0.048 | 101.7 | 1.668 | 5.37 | 5 | 11.2 | 5.9 | 8.8 | 66.7 | 64.6 | |
| DeepSeek-R1-0528-Qwen3-8BModel Category=Distilled Models2026.03 | 80.8 | 8,816.8 | 303.1 | 0.059 | 449.1 | 1.677 | 6.21 | 6 | 13.9 | 11.8 | 12.3 | 74.2 | 82 | |
| Doubao-Seed-1.6-Flash-ThinkingModel Category=Proprietary Models2026.03 | 80.3 | 2,756 | 35.8 | 0.004 | 59.9 | 1.761 | 4.41 | 4.21 | 12.3 | 7.2 | 9.8 | 54.9 | 24.1 | |
| Gemini-2.5-Flash-ThinkingModel Category=Proprietary Models2026.03 | 79.7 | 5,146.6 | 13.4 | 0.027 | 15.7 | 1.23 | 3.1 | 2.8 | 3.3 | 7.7 | 8.9 | 37.7 | 3.7 | |
| DeepSeek-R1-Distill-Llama-70BModel Category=Distilled Models2026.03 | 79.6 | 3,402.8 | 91.9 | 0.026 | 152.1 | 1.964 | 6.31 | 6.31 | 14.7 | 8.2 | 10.1 | 72.5 | 69.4 | |
| Gemini-2.5-ProModel Category=Proprietary Models2026.03 | 78.9 | 3,557 | 13 | 0.032 | 14.8 | 1.229 | 3 | 2.9 | 5 | 6.9 | 8.9 | 39.3 | 7.3 | |
| Kimi-K2-ThinkingModel Category=Open-Source Models2026.03 | 77.8 | 2,474.4 | 42.1 | 0.031 | 69.1 | 1.784 | 5.74 | 5.4 | 14.9 | 6 | 8.6 | 68.7 | 56.1 | |
| Claude-Sonnet-4.5Model Category=Proprietary Models2026.03 | 77.5 | 450.5 | 21.8 | 0.012 | 24 | 1.138 | 2.71 | 2.59 | 8.7 | 8.2 | 11.9 | 36.8 | 3.1 | |
| gpt-oss-20bModel Category=Open-Source Models2026.03 | 75.8 | 2,185.6 | 34.4 | 0.051 | 51.5 | 1.367 | 2.44 | 2.32 | 8.1 | 9.5 | 8.8 | 49.8 | 36.6 | |
| DeepSeek-R1-Distill-Qwen-14BModel Category=Distilled Models2026.03 | 71.7 | 3,256.1 | 96.2 | 0.035 | 142 | 1.409 | 5.79 | 5.57 | 11 | 8 | 11.2 | 75.4 | 42.7 | |
| DeepSeek-R1-Distill-Qwen-32BModel Category=Distilled Models2026.03 | 70.8 | 2,141 | 63.5 | 0.038 | 91.9 | 1.275 | 4.34 | 4.2 | 8.1 | 5.9 | 11.1 | 69.9 | 28.2 | |
| Gemini-3-ProModel Category=Proprietary Models2026.03 | 70.3 | 4,160.4 | 10.7 | 0.04 | 11.2 | 1.129 | 2.06 | 1.94 | 5 | 15.3 | 7 | 33.3 | 4.9 | |
| DeepSeek-R1-Distill-Llama-8BModel Category=Distilled Models2026.03 | 59.8 | 5,090.6 | 159.2 | 0.025 | 225.7 | 1.583 | 4.9 | 4.81 | 11.7 | 10.8 | 12.2 | 75.3 | 62.6 | |
| DeepSeek-R1-Distill-Qwen-7BModel Category=Distilled Models2026.03 | 56 | 3,596.5 | 108.7 | 0.038 | 153.2 | 1.442 | 4.77 | 4.53 | 11.8 | 8.3 | 12.9 | 71 | 51.2 |