List your company
ResearchFormerly WizWand

Math Problem Solving on AMC23

70.6AccuracyTaH+
8.51224.63140.7556.869Nov 11, 2025Dec 12, 2025Jan 12, 2026Feb 12, 2026Mar 15, 2026Apr 15, 2026May 17, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TaH+Param.=4B2025.1170.6
TaHParam.=4B2025.1170.3
TaHModel Size=4B*2025.1169.7
TaH+Model Size=4B*2025.1168.1
OuroModel Size=4B*2025.1164.4
StandardModel Size=4B*2025.1164.2
SoftThinkParam.=4B2025.1164.1
SoftThinkModel Size=4B*2025.1163.1
StandardParam.=4B2025.1162.8
RoutingParam.=4B2025.1160.9
Fine-tunedBase LLM=Qwen-2.5-7B-Instruct, Parameters=x4, Evaluation Protocol=0 shot, CoT2026.0557.5
Zero-shotBase LLM=Qwen-2.5-7B-Instruct, Parameters=x1, Evaluation Protocol=0 shot, CoT2026.0552.5
DiDi-Merg.-LBase LLM=Qwen-2.5-7B-Instruct, Parameters=x2.0, Evaluation Protocol=0 shot, CoT2026.0552.5
TaH+Param.=1.7B2025.1151.2
Twin-MergingBase LLM=Qwen-2.5-7B-Instruct, Parameters=x2.25, Evaluation Protocol=0 shot, CoT2026.0550
TaHParam.=1.7B2025.1148.4
TaH+Model Size=1.7B2025.1148.4
FREE-MergingBase LLM=Qwen-2.5-7B-Instruct, Parameters=x2.08, Evaluation Protocol=0 shot, CoT2026.0547.5
SoftThinkParam.=1.7B2025.1143.1
AlwaysThinkParam.=1.7B2025.1142.5
StandardParam.=1.7B2025.1142.2
RoutingParam.=1.7B2025.1142.2
AlwaysThinkModel Size=1.7B2025.1140.9
TaHModel Size=1.7B2025.1140.9
OuroModel Size=1.7B2025.1140.6
SoftThinkModel Size=1.7B2025.1140.3
StandardModel Size=1.7B2025.1139.7
Fine-tunedBase LLM=Llama-3.1-8B-Instruct, Parameters=x4, Evaluation Protocol=0 shot, CoT2026.0537.5
DiDi-Merg.-LBase LLM=Llama-3.1-8B-Instruct, Parameters=x2.0, Evaluation Protocol=0 shot, CoT2026.0535
TaHParam.=0.6B2025.1132.5
TaH+Param.=0.6B2025.1130.6
Twin-MergingBase LLM=Llama-3.1-8B-Instruct, Parameters=x2.25, Evaluation Protocol=0 shot, CoT2026.0527.5
FREE-MergingBase LLM=Llama-3.1-8B-Instruct, Parameters=x2.08, Evaluation Protocol=0 shot, CoT2026.0527.5
Zero-shotBase LLM=Llama-3.1-8B-Instruct, Parameters=x1, Evaluation Protocol=0 shot, CoT2026.0525
TaH+Model Size=0.6B2025.1124.7
SoftThinkParam.=0.6B2025.1124.1
TaHModel Size=0.6B2025.1124.1
StandardParam.=0.6B2025.1123.4
StandardModel Size=0.6B2025.1122.7
SoftThinkModel Size=0.6B2025.1122.2
AlwaysThinkModel Size=0.6B2025.1121.9
OuroModel Size=0.6B2025.1119.7
AlwaysThinkParam.=0.6B2025.1115.6
RoutingParam.=0.6B2025.1110.9