List your company
ResearchFormerly WizWand

Mathematical Reasoning on AMC 2023 (Token Usage and Cost)

26,854.97Input TokensBoT
-849.52766,342.986213,535.520,728.0138Sep 26, 2025
Updated 7mo ago

Evaluation results

MethodLinks
BoTLLM=Qwen3-8B2025.0926,854.9713,929.851.36
BoTLLM=Qwen3-4B2025.0921,432.0314,008.550.8
BoTLLM=Qwen3-1.7B2025.0917,918.0732,453.731.71
BoTLLM=Qwen3-0.6B2025.095,604.9616,338.730.85
CoT-SCLLM=Qwen3-0.6B2025.09806.525,384.621.28
CoT-SCLLM=Qwen3-1.7B2025.09806.524,485.751.24
CoT-SCLLM=Qwen3-4B2025.09806.518,335.850.93
CoT-SCLLM=Qwen3-8B2025.09806.520,157.051.7
CoT-SCLLM=Qwen3-14B2025.09769.5216,263.32.74
RAGLLM=Qwen3-0.6B2025.09371.276,665.850.34
RAGLLM=Qwen3-1.7B2025.09371.276,471.270.33
RAGLLM=Qwen3-4B2025.09371.275,869.520.3
RAGLLM=Qwen3-8B2025.09371.276,589.450.56
RoT + TILLM=Qwen3-0.6B2025.09286.022,003.90.1
RoT + TILLM=Qwen3-1.7B2025.09286.025,669.450.29
RoT + TILLM=Qwen3-4B2025.09286.024,766.880.24
RoT + TILLM=Qwen3-8B2025.09286.025,494.730.46
RoT + TILLM=Qwen3-14B2025.09286.024,905.550.83
CoTLLM=Qwen3-0.6B2025.09260.576,186.570.31
CoTLLM=Qwen3-1.7B2025.09260.576,142.520.31
CoTLLM=Qwen3-4B2025.09260.575,289.60.27
CoTLLM=Qwen3-8B2025.09260.576,207.50.52
CoTLLM=Qwen3-14B2025.09260.575,409.10.91
RAGLLM=Qwen3-14B2025.09252.555,024.520.85
RoTLLM=Qwen3-0.6B2025.09216.037,172.120.36
RoTLLM=Qwen3-1.7B2025.09216.038,262.920.42
RoTLLM=Qwen3-4B2025.09216.035,916.980.3
RoTLLM=Qwen3-8B2025.09216.036,306.50.53
RoTLLM=Qwen3-14B2025.09216.035,898.850.99