Mathematical Reasoning on MATH-500 (Accuracy and Token Count)
95.52AccuracyCoT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CoTModel=Gemma32026.03 | 95.52 | — | — | — | 3,107 | |
| CoTModel=Llama3.12026.03 | 93.55 | — | — | — | 2,783 | |
| CoTModel=Qwen3-8B2026.03 | 92.05 | — | — | — | 2,680 | |
| LYNXBackbone=QwQ-32B, Conf=0.97, Temperature=0.02025.12 | 91.4 | 0.44 | 3,379.23 | -14.4 | — | |
| BaselineBackbone=QwQ-32B, Temperature=0.02025.12 | 91 | — | 3,945.49 | — | — | |
| LYNXBackbone=QwQ-32B, Conf=0.95, Temperature=0.02025.12 | 90.8 | -0.22 | 3,060.71 | -22.4 | — | |
| DEERBackbone=QwQ-32B, Temperature=0.02025.12 | 90.6 | -0.44 | 3,072.83 | -22.1 | — | |
| LYNXBackbone=QwQ-32B, Conf=0.90, Temperature=0.02025.12 | 89 | -2.2 | 2,816.04 | -28.6 | — | |
| LYNXBackbone=QwQ-32B, Conf=0.80, Temperature=0.02025.12 | 87 | -4.4 | 2,510.93 | -36.4 | — | |
| LYNXBackbone=QwQ-32B, Conf=0.70, Temperature=0.02025.12 | 79.8 | -12.31 | 1,968.3 | -50.1 | — | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.95, Temperature=0.02025.12 | 76.2 | 12.06 | 3,930.17 | -35.5 | — | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.90, Temperature=0.02025.12 | 75.8 | 11.47 | 3,212.87 | -47.3 | — | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.97, Temperature=0.02025.12 | 74.6 | 9.71 | 4,511.43 | -25.9 | — | |
| ToNBackbone=QwQ-32B, Temperature=0.02025.12 | 73.2 | -19.56 | 2,390.42 | -39.4 | — | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.80, Temperature=0.02025.12 | 70.2 | 3.24 | 2,427.41 | -60.1 | — | |
| BaselineBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Temperature=0.02025.12 | 68 | — | 6,090.96 | — | — | |
| DEERBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Temperature=0.02025.12 | 66.8 | -1.76 | 2,446.44 | -59.8 | — | |
| LYNXBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Conf=0.70, Temperature=0.02025.12 | 60.2 | -11.47 | 1,669.69 | -72.6 | — | |
| ToNBackbone=DeepSeek-R1-Distill-Qwen-1.5B, Temperature=0.02025.12 | 54.2 | -20.29 | 3,438.84 | -43.5 | — | |
| DPTSModel=Qwen3-8B2026.03 | 2.5 | — | — | — | 2,699 | |
| ToTModel=Llama3.12026.03 | 2.16 | — | — | — | 3,869 | |
| ToTModel=Qwen3-8B2026.03 | 2.15 | — | — | — | 3,488 | |
| DSTModel=Qwen3-8B2026.03 | 2.12 | — | — | — | 762 | |
| ToTModel=Gemma32026.03 | 2.03 | — | — | — | 4,358 | |
| DPTSModel=Llama3.12026.03 | 1.87 | — | — | — | 2,924 | |
| DSTModel=Llama3.12026.03 | 1.73 | — | — | — | 774 | |
| DSTModel=Gemma32026.03 | 1.58 | — | — | — | 1,045 | |
| DPTSModel=Gemma32026.03 | 1.45 | — | — | — | 3,359 |