Mathematical Reasoning on AIME 2024 (Token Usage and Cost)
25,573.15Input TokensBoT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BoTLLM=Qwen3-8B2025.09 | 25,573.15 | 24,420 | 1.51 | |
| BoTLLM=Qwen3-4B2025.09 | 22,015.56 | 21,158.81 | 0.79 | |
| BoTLLM=Qwen3-1.7B2025.09 | 15,296.48 | 26,651.48 | 0.95 | |
| BoTLLM=Qwen3-0.6B2025.09 | 6,530.7 | 29,351.3 | 1.02 | |
| CoT-SCLLM=Qwen3-0.6B2025.09 | 900 | 46,658.93 | 1.59 | |
| CoT-SCLLM=Qwen3-8B2025.09 | 899.78 | 40,227.7 | 2.29 | |
| CoT-SCLLM=Qwen3-14B2025.09 | 891.41 | 36,064.26 | 4.1 | |
| CoT-SCLLM=Qwen3-4B2025.09 | 889.48 | 37,251.44 | 1.27 | |
| CoT-SCLLM=Qwen3-1.7B2025.09 | 598.74 | 29,708.44 | 1.01 | |
| RAGLLM=Qwen3-0.6B2025.09 | 386 | 12,147.04 | 0.41 | |
| RAGLLM=Qwen3-1.7B2025.09 | 386 | 11,844.67 | 0.4 | |
| RAGLLM=Qwen3-4B2025.09 | 386 | 9,949.7 | 0.34 | |
| RAGLLM=Qwen3-8B2025.09 | 386 | 11,897.48 | 0.68 | |
| RoT + TILLM=Qwen3-0.6B2025.09 | 343.59 | 3,975.11 | 0.14 | |
| RoT + TILLM=Qwen3-1.7B2025.09 | 343.59 | 8,830.37 | 0.3 | |
| RoT + TILLM=Qwen3-4B2025.09 | 343.59 | 9,138 | 0.31 | |
| RoT + TILLM=Qwen3-8B2025.09 | 343.59 | 10,586.44 | 0.6 | |
| RoT + TILLM=Qwen3-14B2025.09 | 343.59 | 10,857.44 | 1.23 | |
| CoTLLM=Qwen3-0.6B2025.09 | 279.59 | 13,253.44 | 0.45 | |
| CoTLLM=Qwen3-1.7B2025.09 | 279.59 | 11,246.3 | 0.38 | |
| CoTLLM=Qwen3-4B2025.09 | 279.59 | 9,796.56 | 0.33 | |
| CoTLLM=Qwen3-8B2025.09 | 279.59 | 10,952.96 | 0.62 | |
| CoTLLM=Qwen3-14B2025.09 | 279.59 | 9,405.63 | 1.07 | |
| RoTLLM=Qwen3-0.6B2025.09 | 273.44 | 11,678.85 | 0.4 | |
| RoTLLM=Qwen3-1.7B2025.09 | 273.44 | 11,163.44 | 0.38 | |
| RoTLLM=Qwen3-4B2025.09 | 273.44 | 10,347.89 | 0.35 | |
| RoTLLM=Qwen3-8B2025.09 | 273.44 | 11,288.48 | 0.64 | |
| RoTLLM=Qwen3-14B2025.09 | 273.44 | 10,805 | 1.23 | |
| RAGLLM=Qwen3-14B2025.09 | 271.19 | 10,710.19 | 1.22 |