List your company
ResearchFormerly WizWand

Mathematical Problem Solving on AIME 25 (Time/Efficiency)

15.69Average TimeCoT
0.6812101.9906203.3304.6094Jul 20, 2025
Updated 5mo ago

Evaluation results

MethodLinks
CoTModel=Qwen3-1.7B2025.0715.699.91—
LLM As a CriticModel=Qwen3-1.7B, Variant=Per-Step Scale2025.0719.6215.46—
LLM As a CriticModel=Qwen3-1.7B, Variant=Avg uncertainty2025.0721.1316.941.48
CoTModel=Qwen3-4B2025.0721.915.63—
Guided SearchModel=Qwen3-1.7B, Variant=MUR2025.0725.1116.8-35.81
LLM As a CriticModel=Qwen3-1.7B, Variant=MUR2025.0725.417.752.29
Guided SearchModel=Qwen3-1.7B, Variant=Avg uncertainty2025.0731.6722.41-30.2
ϕ-DecodingModel=Qwen3-1.7B, Variant=MUR2025.0736.621.81-21.57
ϕ-DecodingModel=Qwen3-1.7B, Variant=Avg uncertainty2025.0738.6123.55-19.83
LLM As a CriticModel=Qwen3-1.7B, Variant=SMART2025.0744.9326.6611.2
Guided SearchModel=Qwen3-4B, Variant=MUR2025.0746.534.11-60.24
ϕ-DecodingModel=Qwen3-1.7B, Variant=SMART2025.0750.2134.45-8.93
Guided SearchModel=Qwen3-1.7B, Variant=SMART2025.0755.0337.37-15.24
LLM As a CriticModel=Qwen3-4B, Variant=MUR2025.0756.438.41-20.81
LLM As a CriticModel=Qwen3-4B, Variant=SMART2025.0761.6337.26-21.96
ϕ-DecodingModel=Qwen3-1.7B, Variant=Per-Step Scale2025.0762.5643.38—
CoTModel=Qwen3-8B2025.0765.9245.38—
LLM As a CriticModel=Qwen3-4B, Variant=Per-Step Scale2025.0770.959.22—
LLM As a CriticModel=Qwen3-4B, Variant=Avg uncertainty2025.0771.1747.86-11.36
Guided SearchModel=Qwen3-1.7B, Variant=Per-Step Scale2025.0773.3452.61—
ϕ-DecodingModel=Qwen3-4B, Variant=Avg uncertainty2025.0774.5359.94-35.07
Guided SearchModel=Qwen3-4B, Variant=Avg uncertainty2025.0776.862.78-31.57
ϕ-DecodingModel=Qwen3-4B, Variant=MUR2025.0792.7358.06-36.95
LLM As a CriticModel=Qwen3-8B, Variant=MUR2025.07100.0272.22-6.65
LLM As a CriticModel=Qwen3-8B, Variant=SMART2025.07107.2977.09-1.78
LLM As a CriticModel=Qwen3-8B, Variant=Per-Step Scale2025.07108.8178.87—
LLM As a CriticModel=Qwen3-8B, Variant=Avg uncertainty2025.07122.6478.8-0.07
ϕ-DecodingModel=Qwen3-4B, Variant=Per-Step Scale2025.07123.5795.01—
Guided SearchModel=Qwen3-4B, Variant=Per-Step Scale2025.07125.894.35—
ϕ-DecodingModel=Qwen3-4B, Variant=SMART2025.07137.291.93-3.08
Guided SearchModel=Qwen3-8B, Variant=MUR2025.07172.6113.52-93.68
Guided SearchModel=Qwen3-8B, Variant=Avg uncertainty2025.07179.73114.81-92.39
Guided SearchModel=Qwen3-4B, Variant=SMART2025.07181.0796.382.03
Guided SearchModel=Qwen3-8B, Variant=SMART2025.07207.56137.16-70.04
ϕ-DecodingModel=Qwen3-8B, Variant=MUR2025.07253.98160.16-79.94
ϕ-DecodingModel=Qwen3-8B, Variant=Avg uncertainty2025.07267.33163.97-76.13
ϕ-DecodingModel=Qwen3-8B, Variant=SMART2025.07306.03207.32-32.78
Guided SearchModel=Qwen3-8B, Variant=Per-Step Scale2025.07338.58207.2—
ϕ-DecodingModel=Qwen3-8B, Variant=Per-Step Scale2025.07390.91240.1—