List your company
ResearchFormerly WizWand

Mathematics on GSM8K (Accuracy)

94.4AccuracyCOSE
-0.44824.17648.873.424May 17, 2026May 22, 2026May 27, 2026Jun 1, 2026Jun 6, 2026Jun 11, 2026Jun 17, 2026
Updated 4mo ago

Evaluation results

MethodLinks
COSEBackbone=Qwen3-4B2026.0594.4
AZRBackbone=Qwen3-4B2026.0593.2
MAEBackbone=Qwen3-4B2026.0592.8
Fine-tunedBase LLM=Qwen-2.5-7B-Instruct, Parameters=x4, Evaluation Protocol=0 shot, CoT2026.0592.6
R-ZeroBackbone=Qwen3-4B2026.0592.4
Zero-shotBase LLM=Qwen-2.5-7B-Instruct, Parameters=x1, Evaluation Protocol=0 shot, CoT2026.0591.7
DiDi-Merg.-LBase LLM=Qwen-2.5-7B-Instruct, Parameters=x2.0, Evaluation Protocol=0 shot, CoT2026.0591.6
Twin-MergingBase LLM=Qwen-2.5-7B-Instruct, Parameters=x2.25, Evaluation Protocol=0 shot, CoT2026.0591.3
FREE-MergingBase LLM=Qwen-2.5-7B-Instruct, Parameters=x2.08, Evaluation Protocol=0 shot, CoT2026.0591.3
COSEBackbone=Llama-3.2-3B-Instruct2026.0589
Fine-tunedBase LLM=Llama-3.1-8B-Instruct, Parameters=x4, Evaluation Protocol=0 shot, CoT2026.0588.8
FREE-MergingBase LLM=Llama-3.1-8B-Instruct, Parameters=x2.08, Evaluation Protocol=0 shot, CoT2026.0588.2
DiDi-Merg.-LBase LLM=Llama-3.1-8B-Instruct, Parameters=x2.0, Evaluation Protocol=0 shot, CoT2026.0588
Twin-MergingBase LLM=Llama-3.1-8B-Instruct, Parameters=x2.25, Evaluation Protocol=0 shot, CoT2026.0586.4
Zero-shotBase LLM=Llama-3.1-8B-Instruct, Parameters=x1, Evaluation Protocol=0 shot, CoT2026.0585.9
BaseBackbone=Qwen3-4B2026.0585
MAEBackbone=Llama-3.2-3B-Instruct2026.0575.2
R-ZeroBackbone=Llama-3.2-3B-Instruct2026.0573.8
AZRBackbone=Llama-3.2-3B-Instruct2026.0572.4
BaseBackbone=Llama-3.2-3B-Instruct2026.0563
pmathModel variant=Mathematics specialized expert2026.0550.2
Model Swarms2026.0646.85
MERGEvolve2026.0642.5
LoraHub2026.0641.8
EMM2026.0641.25
p^ (selective composition)Model variant=Composed model (pbase, pmath, pcoding)2026.0541.2
Expert Fusion2026.0640.52
Pack of LLMs2026.0637.9
pbaseModel variant=Gemma 2 2B base model2026.053.2
pcodingModel variant=Coding specialized expert2026.053.2