Arithmetic Reasoning on In-domain (test)
53.4AccuracyTask+UC
Evaluation Results
| Method | Links | |
|---|---|---|
| Task+UCBackbone=Qwen2.5-7B-I, Tuning Strategy=LoRA2026.01 | 53.4 | |
| Task+AlpacaBackbone=Qwen2.5-7B-I, Tuning Strategy=LoRA2026.01 | 53.3 | |
| SA-SFTBackbone=LLaMA2-13B-C, Tuning Strategy=full2026.01 | 53.3 | |
| Task-onlyBackbone=Qwen2.5-7B-I, Tuning Strategy=LoRA2026.01 | 53.2 | |
| SA-SFTBackbone=Qwen2.5-7B-I, Tuning Strategy=full2026.01 | 52.9 | |
| Task-onlyBackbone=LLaMA2-13B-C, Tuning Strategy=LoRA2026.01 | 52.9 | |
| SA-SFTBackbone=LLaMA2-13B-C, Tuning Strategy=LoRA2026.01 | 52.9 | |
| Task-onlyBackbone=Qwen2.5-7B-I, Tuning Strategy=full2026.01 | 52.8 | |
| Task+AlpacaBackbone=Qwen2.5-7B-I, Tuning Strategy=full2026.01 | 52.8 | |
| Task+UCBackbone=Qwen2.5-7B-I, Tuning Strategy=full2026.01 | 52.7 | |
| Task+UCBackbone=LLaMA2-13B-C, Tuning Strategy=full2026.01 | 52.6 | |
| Task+AlpacaBackbone=LLaMA2-13B-C, Tuning Strategy=LoRA2026.01 | 52.3 | |
| SA-SFTBackbone=LLaMA2-7B-C, Tuning Strategy=full2026.01 | 52.2 | |
| FreezeBackbone=LLaMA2-13B-C, Tuning Strategy=full2026.01 | 52.2 | |
| Task-onlyBackbone=LLaMA2-13B-C, Tuning Strategy=full2026.01 | 52.1 | |
| Task-onlyBackbone=LLaMA2-7B-C, Tuning Strategy=LoRA2026.01 | 51.8 | |
| SA-SFTBackbone=LLaMA2-7B-C, Tuning Strategy=LoRA2026.01 | 51.7 | |
| FreezeBackbone=LLaMA2-7B-C, Tuning Strategy=full2026.01 | 51.6 | |
| Task+UCBackbone=LLaMA2-13B-C, Tuning Strategy=LoRA2026.01 | 51.4 | |
| Task+UCBackbone=LLaMA2-7B-C, Tuning Strategy=full2026.01 | 51.3 | |
| Task+UCBackbone=LLaMA2-7B-C, Tuning Strategy=LoRA2026.01 | 51.3 | |
| SA-SFTBackbone=LLaMA3-8B-I, Tuning Strategy=full2026.01 | 50.8 | |
| Task-onlyBackbone=LLaMA3-8B-I, Tuning Strategy=full2026.01 | 50.5 | |
| Task-onlyBackbone=LLaMA2-7B-C, Tuning Strategy=full2026.01 | 50.4 | |
| Task+AlpacaBackbone=LLaMA2-13B-C, Tuning Strategy=full2026.01 | 50.4 | |
| Task+UCBackbone=LLaMA3-8B-I, Tuning Strategy=full2026.01 | 50.3 | |
| Task+AlpacaBackbone=LLaMA2-7B-C, Tuning Strategy=full2026.01 | 49.8 | |
| SA-SFTBackbone=Qwen2.5-7B-I, Tuning Strategy=LoRA2026.01 | 49.8 | |
| SA-SFTBackbone=LLaMA3-8B-I, Tuning Strategy=LoRA2026.01 | 49.5 | |
| FreezeBackbone=LLaMA3-8B-I, Tuning Strategy=full2026.01 | 48.7 | |
| Task+AlpacaBackbone=LLaMA2-7B-C, Tuning Strategy=LoRA2026.01 | 48.3 | |
| Task-onlyBackbone=LLaMA3-8B-I, Tuning Strategy=LoRA2026.01 | 46.3 | |
| Task+UCBackbone=LLaMA3-8B-I, Tuning Strategy=LoRA2026.01 | 45.9 | |
| SA-SFTBackbone=LLaMA3.2-3B-I, Tuning Strategy=full2026.01 | 45.6 | |
| SA-SFTBackbone=LLaMA3.2-3B-I, Tuning Strategy=LoRA2026.01 | 44.7 | |
| Task+AlpacaBackbone=LLaMA3.2-3B-I, Tuning Strategy=full2026.01 | 44.6 | |
| Task+AlpacaBackbone=LLaMA3.2-3B-I, Tuning Strategy=LoRA2026.01 | 44.5 | |
| Task+UCBackbone=LLaMA3.2-3B-I, Tuning Strategy=full2026.01 | 44.5 | |
| Task+UCBackbone=LLaMA3.2-3B-I, Tuning Strategy=LoRA2026.01 | 44.5 | |
| Task+AlpacaBackbone=LLaMA3-8B-I, Tuning Strategy=LoRA2026.01 | 44.5 | |
| Task-onlyBackbone=LLaMA3.2-3B-I, Tuning Strategy=LoRA2026.01 | 44.3 | |
| FreezeBackbone=LLaMA3.2-3B-I, Tuning Strategy=full2026.01 | 44.1 | |
| Task+AlpacaBackbone=LLaMA3-8B-I, Tuning Strategy=full2026.01 | 43.9 | |
| Task-onlyBackbone=LLaMA3.2-3B-I, Tuning Strategy=full2026.01 | 38.7 | |
| FreezeBackbone=Qwen2.5-7B-I, Tuning Strategy=full2026.01 | 30.7 | |
| BaseBackbone=Qwen2.5-7B-I, Tuning Strategy=full2026.01 | 20.2 | |
| BaseBackbone=LLaMA3.2-3B-I, Tuning Strategy=full2026.01 | 13 | |
| BaseBackbone=LLaMA3-8B-I, Tuning Strategy=full2026.01 | 12.2 | |
| BaseBackbone=LLaMA2-7B-C, Tuning Strategy=full2026.01 | 10 | |
| BaseBackbone=LLaMA2-13B-C, Tuning Strategy=full2026.01 | 9.1 |