Mathematical Reasoning on MNNS (val)
98.94AccuracyCoT2
Evaluation Results
| Method | Links | |
|---|---|---|
| CoT2Backbone=2-layer, 2-head GPT2 (d=32), Budget=Full, Input digits=4 digits in 1–92025.05 | 98.94 | |
| COCONUTBackbone=2-layer, 2-head GPT2 (d=32), Input digits=4 digits in 1–92025.05 | 92.58 | |
| Discrete CoTBackbone=2-layer, 2-head GPT2 (d=32), Budget=B=1, Input digits=4 digits in 1–92025.05 | 84.92 | |
| Discrete no-CoTBackbone=2-layer, 2-head GPT2 (d=32), Input digits=4 digits in 1–92025.05 | 68.35 |