List your company
ResearchFormerly WizWand

Arithmetic Reasoning on In-domain (test)

53.4AccuracyTask+UC
7.32819.28931.2543.211Jan 23, 2026
Updated 8mo ago

Evaluation results

MethodLinks
Task+UCBackbone=Qwen2.5-7B-I, Tuning Strategy=LoRA2026.0153.4
Task+AlpacaBackbone=Qwen2.5-7B-I, Tuning Strategy=LoRA2026.0153.3
SA-SFTBackbone=LLaMA2-13B-C, Tuning Strategy=full2026.0153.3
Task-onlyBackbone=Qwen2.5-7B-I, Tuning Strategy=LoRA2026.0153.2
SA-SFTBackbone=Qwen2.5-7B-I, Tuning Strategy=full2026.0152.9
Task-onlyBackbone=LLaMA2-13B-C, Tuning Strategy=LoRA2026.0152.9
SA-SFTBackbone=LLaMA2-13B-C, Tuning Strategy=LoRA2026.0152.9
Task-onlyBackbone=Qwen2.5-7B-I, Tuning Strategy=full2026.0152.8
Task+AlpacaBackbone=Qwen2.5-7B-I, Tuning Strategy=full2026.0152.8
Task+UCBackbone=Qwen2.5-7B-I, Tuning Strategy=full2026.0152.7
Task+UCBackbone=LLaMA2-13B-C, Tuning Strategy=full2026.0152.6
Task+AlpacaBackbone=LLaMA2-13B-C, Tuning Strategy=LoRA2026.0152.3
SA-SFTBackbone=LLaMA2-7B-C, Tuning Strategy=full2026.0152.2
FreezeBackbone=LLaMA2-13B-C, Tuning Strategy=full2026.0152.2
Task-onlyBackbone=LLaMA2-13B-C, Tuning Strategy=full2026.0152.1
Task-onlyBackbone=LLaMA2-7B-C, Tuning Strategy=LoRA2026.0151.8
SA-SFTBackbone=LLaMA2-7B-C, Tuning Strategy=LoRA2026.0151.7
FreezeBackbone=LLaMA2-7B-C, Tuning Strategy=full2026.0151.6
Task+UCBackbone=LLaMA2-13B-C, Tuning Strategy=LoRA2026.0151.4
Task+UCBackbone=LLaMA2-7B-C, Tuning Strategy=full2026.0151.3
Task+UCBackbone=LLaMA2-7B-C, Tuning Strategy=LoRA2026.0151.3
SA-SFTBackbone=LLaMA3-8B-I, Tuning Strategy=full2026.0150.8
Task-onlyBackbone=LLaMA3-8B-I, Tuning Strategy=full2026.0150.5
Task-onlyBackbone=LLaMA2-7B-C, Tuning Strategy=full2026.0150.4
Task+AlpacaBackbone=LLaMA2-13B-C, Tuning Strategy=full2026.0150.4
Task+UCBackbone=LLaMA3-8B-I, Tuning Strategy=full2026.0150.3
Task+AlpacaBackbone=LLaMA2-7B-C, Tuning Strategy=full2026.0149.8
SA-SFTBackbone=Qwen2.5-7B-I, Tuning Strategy=LoRA2026.0149.8
SA-SFTBackbone=LLaMA3-8B-I, Tuning Strategy=LoRA2026.0149.5
FreezeBackbone=LLaMA3-8B-I, Tuning Strategy=full2026.0148.7
Task+AlpacaBackbone=LLaMA2-7B-C, Tuning Strategy=LoRA2026.0148.3
Task-onlyBackbone=LLaMA3-8B-I, Tuning Strategy=LoRA2026.0146.3
Task+UCBackbone=LLaMA3-8B-I, Tuning Strategy=LoRA2026.0145.9
SA-SFTBackbone=LLaMA3.2-3B-I, Tuning Strategy=full2026.0145.6
SA-SFTBackbone=LLaMA3.2-3B-I, Tuning Strategy=LoRA2026.0144.7
Task+AlpacaBackbone=LLaMA3.2-3B-I, Tuning Strategy=full2026.0144.6
Task+AlpacaBackbone=LLaMA3.2-3B-I, Tuning Strategy=LoRA2026.0144.5
Task+UCBackbone=LLaMA3.2-3B-I, Tuning Strategy=full2026.0144.5
Task+UCBackbone=LLaMA3.2-3B-I, Tuning Strategy=LoRA2026.0144.5
Task+AlpacaBackbone=LLaMA3-8B-I, Tuning Strategy=LoRA2026.0144.5
Task-onlyBackbone=LLaMA3.2-3B-I, Tuning Strategy=LoRA2026.0144.3
FreezeBackbone=LLaMA3.2-3B-I, Tuning Strategy=full2026.0144.1
Task+AlpacaBackbone=LLaMA3-8B-I, Tuning Strategy=full2026.0143.9
Task-onlyBackbone=LLaMA3.2-3B-I, Tuning Strategy=full2026.0138.7
FreezeBackbone=Qwen2.5-7B-I, Tuning Strategy=full2026.0130.7
BaseBackbone=Qwen2.5-7B-I, Tuning Strategy=full2026.0120.2
BaseBackbone=LLaMA3.2-3B-I, Tuning Strategy=full2026.0113
BaseBackbone=LLaMA3-8B-I, Tuning Strategy=full2026.0112.2
BaseBackbone=LLaMA2-7B-C, Tuning Strategy=full2026.0110
BaseBackbone=LLaMA2-13B-C, Tuning Strategy=full2026.019.1