Uncertainty Estimation on MATH AutoGen (test)
0.7544AUROCMATU
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MATUBase LLM=Llama3.1-8B2026.04 | 0.7544 | 0.4687 | |
| MATUBase LLM=Qwen2.5-7B2026.04 | 0.7146 | 0.5334 | |
| MATUBase LLM=GPT-4o2026.04 | 0.6582 | 0.622 | |
| P(true)Base LLM=Qwen2.5-7B2026.04 | 0.6524 | 0.5102 | |
| Eigv(Agre)-finalBase LLM=Qwen2.5-7B2026.04 | 0.6355 | 0.4512 | |
| SAUP-MultipleBase LLM=Llama3.1-8B2026.04 | 0.6334 | 0.3933 | |
| P(true)Base LLM=Llama3.1-8B2026.04 | 0.6271 | 0.4571 | |
| Eigv(Agre)-WholeBase LLM=Qwen2.5-7B2026.04 | 0.6111 | 0.4326 | |
| P(true)Base LLM=GPT-4o2026.04 | 0.6079 | 0.5931 | |
| SAUP-SingleBase LLM=Llama3.1-8B2026.04 | 0.6064 | 0.383 | |
| Eigv(Agre)-WholeBase LLM=GPT-4o2026.04 | 0.6015 | 0.5892 | |
| Eigv(Agre)-finalBase LLM=Llama3.1-8B2026.04 | 0.5912 | 0.3802 | |
| Eigv(Agre)-finalBase LLM=GPT-4o2026.04 | 0.5898 | 0.5826 | |
| Eigv(Agre)-WholeBase LLM=Llama3.1-8B2026.04 | 0.5761 | 0.3679 | |
| SAUP-MultipleBase LLM=Qwen2.5-7B2026.04 | 0.5385 | 0.409 | |
| SAUP-SingleBase LLM=Qwen2.5-7B2026.04 | 0.5268 | 0.399 |