Uncertainty Quantification on Countdown, GSM8K, MATH500, SVAMP Combined
63.7Average ROC-AUCDiSE
Evaluation results
| Method | Links | |
|---|---|---|
| DiSEBackbone=LLaDA-Instruct-8B2026.03 | 63.7 | |
| DiSEBackbone=LLaDA-1.5-8B2026.03 | 59.2 | |
| LLaMA perplexityBackbone=LLaDA-Instruct-8B, Evaluation Model=LLaMA3-Instruct-8B2026.03 | 57.8 | |
| MCBackbone=LLaDA-Instruct-8B, Nmc=322026.03 | 57.3 | |
| LLaMA perplexityBackbone=LLaDA-1.5-8B, Evaluation Model=LLaMA3-Instruct-8B2026.03 | 57.2 | |
| MCBackbone=LLaDA-1.5-8B, Nmc=322026.03 | 56.7 | |
| MCBackbone=LLaDA-1.5-8B, Nmc=12026.03 | 53.5 | |
| MCBackbone=LLaDA-Instruct-8B, Nmc=12026.03 | 53.2 |