Mathematical Reasoning on DU
84.09AccuracyLTF
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LTFModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 84.09 | 1.2 | |
| ReGuLaRModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 81.06 | 1.19 | |
| LTFModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 76.82 | 1.17 | |
| CoLaRModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 76.59 | 4.18 | |
| CoconutModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 73.74 | 6 | |
| iCoTModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 71.27 | 0 | |
| ReGuLaRModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 70.31 | 1.18 | |
| LTFModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 69.8 | 1.17 | |
| SoftCoT++Model=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 68.89 | 120.15 | |
| LTFModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 66.83 | 1.18 | |
| Assist-CoTModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 65.82 | 120.39 | |
| CoTModel=LLaMA-3.1 Instruct 8B, Finetuning Setting=true2026.06 | 65.67 | 121.04 | |
| ReGuLaRModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 63.91 | 1.19 | |
| CoLaRModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 61.29 | 4.15 | |
| ReGuLaRModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 59.92 | 1.2 | |
| CoconutModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 57.23 | 6 | |
| iCoTModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 54.18 | 0 | |
| SoftCoT++Model=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 53.31 | 119.85 | |
| CoLaRModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 50.35 | 4.17 | |
| Assist-CoTModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 50.28 | 120.04 | |
| CoLaRModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 50.12 | 4.17 | |
| CoTModel=LLaMA-3.2 Instruct 3B, Finetuning Setting=true2026.06 | 48.9 | 121.75 | |
| CoconutModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 46.46 | 6 | |
| CoconutModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 43.97 | 6 | |
| iCoTModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 43.18 | 0 | |
| SoftCoT++Model=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 43.04 | 119.83 | |
| iCoTModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 41.37 | 0 | |
| Assist-CoTModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 38.62 | 119.67 | |
| SoftCoT++Model=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 38.18 | 119.7 | |
| CODIModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 38.06 | 6 | |
| CoTModel=DeepSeek-R1-Distill-Qwen-1.5B, Finetuning Setting=true2026.06 | 37.02 | 120.09 | |
| Assist-CoTModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 35.34 | 119.58 | |
| CoTModel=LLaMA-3.2 Instruct 1B, Finetuning Setting=true2026.06 | 33.18 | 120.01 |