Mathematical Reasoning on ASDiv Aug (Acc, #L)
94.02AccuracyLTF
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LTFModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 94.02 | 1.24 | |
| ReGuLaRModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 92 | 1.28 | |
| CoLaRModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 91.12 | 5.51 | |
| CoconutModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 91.09 | 6 | |
| iCoTModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 91.03 | 0 | |
| SoftCoT++Model=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 90.09 | 120.52 | |
| Assist-CoTModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 89.48 | 121.51 | |
| CoTModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 89.23 | 121.93 | |
| LTFModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 84.04 | 1.21 | |
| LTFModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 79.75 | 1.2 | |
| ReGuLaRModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 79.46 | 1.24 | |
| ReGuLaRModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 75.59 | 1.21 | |
| LTFModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 75.11 | 1.22 | |
| CoLaRModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 73.05 | 5.17 | |
| ReGuLaRModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 72.19 | 1.24 | |
| CoLaRModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 69.36 | 5.23 | |
| CoLaRModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 67.19 | 5.19 | |
| CoconutModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 66.76 | 6 | |
| iCoTModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 58.45 | 0 | |
| CoconutModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 56.85 | 6 | |
| SoftCoT++Model=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 56.39 | 119.97 | |
| CoconutModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 53.18 | 6 | |
| Assist-CoTModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 52.42 | 120.11 | |
| CoTModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 51.08 | 121.67 | |
| iCoTModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 48.53 | 0 | |
| SoftCoT++Model=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 48.51 | 119.93 | |
| Assist-CoTModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 46.48 | 119.81 | |
| iCoTModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 46.36 | 0 | |
| SoftCoT++Model=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 45.72 | 119.48 | |
| CoTModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 45.7 | 120.7 | |
| CODIModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 43.93 | 6 | |
| Assist-CoTModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 42.18 | 119.53 | |
| CoTModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 40.85 | 120.73 |