Mathematical Reasoning on GSM8k 2021 (test)
100Accuracyentropy-guided decoding
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| entropy-guided decodingModel=GPT4o2026.03 | 100 | 96.3 | 1.3 | 19 | 98.7 | 99.6 | 42.2 | |
| entropy-guided decodingModel=Llama3.1-8B2026.03 | 99.6 | 84.2 | 1.4 | 23 | 99.3 | 99.7 | 30.2 | |
| SFT No-TestModel variant=SFT No-Test2026.04 | 80.7 | — | — | — | — | — | — | |
| Merged (α=0.2)Model variant=Merged (α=0.2), Interpolation Weight=0.22026.04 | 68.3 | — | — | — | — | — | — | |
| Qwen3-4B-Instruct-2507Model variant=Base Model2026.04 | 66.3 | — | — | — | — | — | — |