List your company
ResearchFormerly WizWand

Mathematical Reasoning on MultiArith (Accuracy, Reasoning Length)

97.18AccuracyLTF
16.080837.135458.1979.2446Jun 15, 2026
Updated 4mo ago

Evaluation results

MethodLinks
LTFBackbone=LLaMA-3.1 Instruct 8B2026.0697.182.16
ReGuLaRBackbone=LLaMA-3.1 Instruct 8B2026.0695.282.26
CoLaRBackbone=LLaMA-3.1 Instruct 8B2026.0693.83.14
LTFBackbone=LLaMA-3.2 Instruct 3B2026.0692.942.1
ReGuLaRBackbone=LLaMA-3.2 Instruct 3B2026.0691.272.17
LTFBackbone=DeepSeek-R1 Distill-Qwen 1.5B2026.0691.12.21
LTFBackbone=LLaMA-3.2 Instruct 1B2026.0690.372.17
CoLaRBackbone=LLaMA-3.2 Instruct 3B2026.0690.13.04
ReGuLaRBackbone=DeepSeek-R1 Distill-Qwen 1.5B2026.0689.042.29
ReGuLaRBackbone=LLaMA-3.2 Instruct 1B2026.0688.972.29
CoLaRBackbone=DeepSeek-R1 Distill-Qwen 1.5B2026.0687.013.22
CoLaRBackbone=LLaMA-3.2 Instruct 1B2026.0686.933.22
CoconutBackbone=LLaMA-3.1 Instruct 8B2026.0662.416
CoconutBackbone=LLaMA-3.2 Instruct 3B2026.0658.796
iCoTBackbone=LLaMA-3.1 Instruct 8B2026.0650.390
iCoTBackbone=LLaMA-3.2 Instruct 3B2026.0646.420
SoftCoT++Backbone=LLaMA-3.1 Instruct 8B2026.0643.19121.98
CoconutBackbone=DeepSeek-R1 Distill-Qwen 1.5B2026.0641.316
CoconutBackbone=LLaMA-3.2 Instruct 1B2026.0641.36
Assist-CoTBackbone=LLaMA-3.1 Instruct 8B2026.0640.6122.64
SoftCoT++Backbone=LLaMA-3.2 Instruct 3B2026.0640.26121.74
CoTBackbone=LLaMA-3.1 Instruct 8B2026.0638.82121.84
iCoTBackbone=DeepSeek-R1 Distill-Qwen 1.5B2026.0638.240
iCoTBackbone=LLaMA-3.2 Instruct 1B2026.0638.190
Assist-CoTBackbone=LLaMA-3.2 Instruct 3B2026.0637.03121.98
CoTBackbone=LLaMA-3.2 Instruct 3B2026.0635.16121.54
SoftCoT++Backbone=DeepSeek-R1 Distill-Qwen 1.5B2026.0632.18121.92
SoftCoT++Backbone=LLaMA-3.2 Instruct 1B2026.0632.13120.66
Assist-CoTBackbone=DeepSeek-R1 Distill-Qwen 1.5B2026.0630.14122.7
Assist-CoTBackbone=LLaMA-3.2 Instruct 1B2026.0630.06121.86
CoTBackbone=DeepSeek-R1 Distill-Qwen 1.5B2026.0628.33121.53
CoTBackbone=LLaMA-3.2 Instruct 1B2026.0628.29120.14
CODIBackbone=LLaMA-3.2 Instruct 1B2026.0619.26