Mathematical Reasoning on GSM8K (Pass@1, TPR/F1 vs FPR)
38.6Pass@1UW
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| UWModel=LLaMA-3-8B2026.04 | 38.6 | 5.3 | 10 | 12.9 | 21.9 | |
| SWEETModel=LLaMA-3-8B2026.04 | 38.6 | 79.5 | 88.2 | 94.7 | 95.1 | |
| KGWModel=LLaMA-3-8B2026.04 | 37.1 | 63.6 | 77.4 | 65.2 | 76.8 | |
| EWDModel=LLaMA-3-8B2026.04 | 35.6 | 74.2 | 84.8 | 95.5 | 95.5 | |
| EWD + SSGModel=LLaMA-3-8B2026.04 | 35.6 | 99.2 | 99.2 | 99.2 | 97.4 | |
| KGW + SSGModel=LLaMA-3-8B2026.04 | 34.1 | 89.4 | 94 | 91 | 95.5 | |
| SWEET + SSGModel=LLaMA-3-8B2026.04 | 34.1 | 100 | 99.6 | 100 | 97.8 | |
| UWModel=DSMath-7B2026.04 | 27.3 | 4.5 | 8.6 | 6.8 | 12.2 | |
| SWEETModel=DSMath-7B2026.04 | 27.3 | 94.7 | 96.9 | 97 | 96.2 | |
| KGW + SSGModel=DSMath-7B2026.04 | 25.8 | 90.9 | 94.9 | 91.7 | 93.4 | |
| SWEET + SSGModel=DSMath-7B2026.04 | 25 | 94.7 | 96.9 | 97 | 96.2 | |
| EWD + SSGModel=DSMath-7B2026.04 | 25 | 96.2 | 97.7 | 97 | 96.2 | |
| KGWModel=DSMath-7B2026.04 | 21.7 | 41.7 | 58.5 | 57.6 | 71 | |
| EWDModel=DSMath-7B2026.04 | 21.2 | 93.2 | 96.1 | 95.5 | 95.5 |