Mathematical Reasoning on AIME 2023
32,881.13Input TokensBoT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BoTLLM=Qwen3-8B2025.09 | 32,881.13 | 27,089.73 | 0.94 | |
| BoTLLM=Qwen3-4B2025.09 | 25,746.73 | 24,447.8 | 0.5 | |
| BoTLLM=Qwen3-1.7B2025.09 | 17,598.55 | 16,058.92 | 0.33 | |
| BoTLLM=Qwen3-0.6B2025.09 | 8,234.67 | 30,557.5 | 0.59 | |
| CoT-SCLLM=Qwen3-4B2025.09 | 920.67 | 41,082.13 | 0.78 | |
| CoT-SCLLM=Qwen3-8B2025.09 | 920.67 | 42,651.13 | 1.35 | |
| CoT-SCLLM=Qwen3-14B2025.09 | 920.67 | 38,352.2 | 2.42 | |
| CoT-SCLLM=Qwen3-1.7B2025.09 | 919.13 | 46,885.67 | 0.89 | |
| CoT-SCLLM=Qwen3-0.6B2025.09 | 906.13 | 43,614.27 | 0.83 | |
| RAGLLM=Qwen3-0.6B2025.09 | 399.33 | 10,124.53 | 0.19 | |
| RAGLLM=Qwen3-1.7B2025.09 | 399.33 | 12,881.47 | 0.24 | |
| RAGLLM=Qwen3-4B2025.09 | 399.33 | 11,270.93 | 0.21 | |
| RAGLLM=Qwen3-8B2025.09 | 399.33 | 11,378.13 | 0.36 | |
| RoT + TILLM=Qwen3-0.6B2025.09 | 345.8 | 4,932.07 | 0.09 | |
| RoT + TILLM=Qwen3-1.7B2025.09 | 345.8 | 8,222.67 | 0.16 | |
| RoT + TILLM=Qwen3-4B2025.09 | 345.8 | 9,075.2 | 0.17 | |
| RoT + TILLM=Qwen3-8B2025.09 | 345.8 | 10,933.27 | 0.35 | |
| RoT + TILLM=Qwen3-14B2025.09 | 345.8 | 9,421.53 | 0.6 | |
| CoTLLM=Qwen3-0.6B2025.09 | 285.6 | 9,719.33 | 0.18 | |
| CoTLLM=Qwen3-1.7B2025.09 | 285.6 | 12,826.27 | 0.24 | |
| CoTLLM=Qwen3-4B2025.09 | 285.6 | 11,202.73 | 0.21 | |
| CoTLLM=Qwen3-8B2025.09 | 285.6 | 12,485 | 0.39 | |
| CoTLLM=Qwen3-14B2025.09 | 285.6 | 9,165.67 | 0.58 | |
| RAGLLM=Qwen3-14B2025.09 | 277.13 | 9,633.73 | 0.61 | |
| RoTLLM=Qwen3-0.6B2025.09 | 275.8 | 11,718.2 | 0.22 | |
| RoTLLM=Qwen3-1.7B2025.09 | 275.8 | 12,515.93 | 0.24 | |
| RoTLLM=Qwen3-4B2025.09 | 275.8 | 11,358.8 | 0.22 | |
| RoTLLM=Qwen3-8B2025.09 | 275.8 | 12,555.87 | 0.4 | |
| RoTLLM=Qwen3-14B2025.09 | 275.8 | 9,911.2 | 0.63 |