Mathematical Question Answering on MATH 500
0.0202Brier ScoreGUPO + SAGE
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GUPO + SAGEFramework=GUPO, Metric=SAGE2026.06 | 0.0202 | 0.0238 | 0.463 | 0.613 | 0.717 | 0.74 | |
| GUPO + Kernel Language EntropyFramework=GUPO, Metric=Kernel Language Entropy2026.06 | 0.0205 | 0.0348 | 0.451 | 0.588 | 0.7 | 0.72 | |
| CSFTTraining=CSFT2026.06 | 0.064 | 0.143 | 0.5 | 0.625 | 0.7 | 0.74 | |
| LoVeC-DPOTraining=LoVeC-DPO2026.06 | 0.121 | 0.22 | 0.352 | 0.6 | 0.633 | 0.66 | |
| GUPO + Semantic EntropyFramework=GUPO, Metric=Semantic Entropy2026.06 | 0.19 | 0.282 | 0.426 | 0.575 | 0.65 | 0.72 | |
| CoT + DCAStrategy=Chain-of-Thought, Alignment=DCA2026.06 | 0.287 | 0.479 | 0.074 | 0.588 | 0.567 | 0.58 | |
| Direct VerbalizedStrategy=Direct Verbalized2026.06 | 0.359 | 0.546 | 0.246 | 0.563 | 0.617 | 0.66 | |
| Direct Verbalized + DCAStrategy=Direct Verbalized, Alignment=DCA2026.06 | 0.388 | 0.578 | 0.171 | 0.55 | 0.617 | 0.58 | |
| CoTStrategy=Chain-of-Thought2026.06 | 0.396 | 0.582 | 0.175 | 0.588 | 0.617 | 0.6 |