Mathematical Reasoning on AMC 2023 (Token Usage and Cost)
26,854.97Input TokensBoT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BoTLLM=Qwen3-8B2025.09 | 26,854.97 | 13,929.85 | 1.36 | |
| BoTLLM=Qwen3-4B2025.09 | 21,432.03 | 14,008.55 | 0.8 | |
| BoTLLM=Qwen3-1.7B2025.09 | 17,918.07 | 32,453.73 | 1.71 | |
| BoTLLM=Qwen3-0.6B2025.09 | 5,604.96 | 16,338.73 | 0.85 | |
| CoT-SCLLM=Qwen3-0.6B2025.09 | 806.5 | 25,384.62 | 1.28 | |
| CoT-SCLLM=Qwen3-1.7B2025.09 | 806.5 | 24,485.75 | 1.24 | |
| CoT-SCLLM=Qwen3-4B2025.09 | 806.5 | 18,335.85 | 0.93 | |
| CoT-SCLLM=Qwen3-8B2025.09 | 806.5 | 20,157.05 | 1.7 | |
| CoT-SCLLM=Qwen3-14B2025.09 | 769.52 | 16,263.3 | 2.74 | |
| RAGLLM=Qwen3-0.6B2025.09 | 371.27 | 6,665.85 | 0.34 | |
| RAGLLM=Qwen3-1.7B2025.09 | 371.27 | 6,471.27 | 0.33 | |
| RAGLLM=Qwen3-4B2025.09 | 371.27 | 5,869.52 | 0.3 | |
| RAGLLM=Qwen3-8B2025.09 | 371.27 | 6,589.45 | 0.56 | |
| RoT + TILLM=Qwen3-0.6B2025.09 | 286.02 | 2,003.9 | 0.1 | |
| RoT + TILLM=Qwen3-1.7B2025.09 | 286.02 | 5,669.45 | 0.29 | |
| RoT + TILLM=Qwen3-4B2025.09 | 286.02 | 4,766.88 | 0.24 | |
| RoT + TILLM=Qwen3-8B2025.09 | 286.02 | 5,494.73 | 0.46 | |
| RoT + TILLM=Qwen3-14B2025.09 | 286.02 | 4,905.55 | 0.83 | |
| CoTLLM=Qwen3-0.6B2025.09 | 260.57 | 6,186.57 | 0.31 | |
| CoTLLM=Qwen3-1.7B2025.09 | 260.57 | 6,142.52 | 0.31 | |
| CoTLLM=Qwen3-4B2025.09 | 260.57 | 5,289.6 | 0.27 | |
| CoTLLM=Qwen3-8B2025.09 | 260.57 | 6,207.5 | 0.52 | |
| CoTLLM=Qwen3-14B2025.09 | 260.57 | 5,409.1 | 0.91 | |
| RAGLLM=Qwen3-14B2025.09 | 252.55 | 5,024.52 | 0.85 | |
| RoTLLM=Qwen3-0.6B2025.09 | 216.03 | 7,172.12 | 0.36 | |
| RoTLLM=Qwen3-1.7B2025.09 | 216.03 | 8,262.92 | 0.42 | |
| RoTLLM=Qwen3-4B2025.09 | 216.03 | 5,916.98 | 0.3 | |
| RoTLLM=Qwen3-8B2025.09 | 216.03 | 6,306.5 | 0.53 | |
| RoTLLM=Qwen3-14B2025.09 | 216.03 | 5,898.85 | 0.99 |