Mathematical Reasoning on GSM-Hard Natural Language version (test)
18.27AccuracyExplicit CoT
Evaluation Results
| Method | Links | |
|---|---|---|
| Explicit CoTBackbone=LLAMA-3.2-3B-INSTRUCT, Training Data=GSM8k-Aug (natural language)2026.06 | 18.27 | |
| LOTUSBackbone=LLAMA-3.2-3B-INSTRUCT, Training Data=GSM8k-Aug (natural language)2026.06 | 16.27 | |
| KaVaBackbone=LLAMA-3.2-3B-INSTRUCT, Training Data=GSM8k-Aug (natural language)2026.06 | 14.8 | |
| CODIBackbone=LLAMA-3.2-3B-INSTRUCT, Training Data=GSM8k-Aug (natural language)2026.06 | 13.6 | |
| PCCoTBackbone=LLAMA-3.2-3B-INSTRUCT, Training Data=GSM8k-Aug (natural language)2026.06 | 11 |