List your company
ResearchFormerly WizWand

Inference Latency on AIME 2023 (Mathematical Reasoning)

32.93Latency (s)RoT + TI
-6.36258.8475524.055789.2625Sep 26, 2025
Updated 7mo ago

Evaluation results

MethodLinks
RoT + TIModel=Qwen3-0.6B2025.0932.93
RoT + TIModel=Qwen3-1.7B2025.0979.28
CoTModel=Qwen3-0.6B2025.0986.7
RAGModel=Qwen3-0.6B2025.0994.75
RoTModel=Qwen3-0.6B2025.09120.11
RoT + TIModel=Qwen3-4B2025.09135.33
RoTModel=Qwen3-1.7B2025.09154.66
CoTModel=Qwen3-1.7B2025.09163.69
RAGModel=Qwen3-1.7B2025.09165.17
CoTModel=Qwen3-4B2025.09182.6
RoTModel=Qwen3-4B2025.09184.52
RAGModel=Qwen3-4B2025.09186.69
BoTModel=Qwen3-1.7B2025.09197.6
CoTModel=Qwen3-14B2025.09241.62
RAGModel=Qwen3-8B2025.09244.59
RoT + TIModel=Qwen3-8B2025.09246.3
RoT + TIModel=Qwen3-14B2025.09251.24
RAGModel=Qwen3-14B2025.09255.87
RoTModel=Qwen3-14B2025.09263.15
RoTModel=Qwen3-8B2025.09273.8
CoTModel=Qwen3-8B2025.09281.04
BoTModel=Qwen3-0.6B2025.09298.48
BoTModel=Qwen3-4B2025.09455.45
CoT-SCModel=Qwen3-0.6B2025.09509.71
CoT-SCModel=Qwen3-1.7B2025.09627.12
CoT-SCModel=Qwen3-4B2025.09715.87
BoTModel=Qwen3-8B2025.09741.66
CoT-SCModel=Qwen3-8B2025.09910.9
CoT-SCModel=Qwen3-14B2025.091,015.18