Uncertainty Estimation on MMLU Camel
0.7149AUROCMATU
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MATUBase LLM=Qwen2.5-7B2026.04 | 0.7149 | 0.8656 | |
| MATUBase LLM=Llama3.1-8B2026.04 | 0.7075 | 0.8427 | |
| P(true)Base LLM=Qwen2.5-7B2026.04 | 0.6846 | 0.8585 | |
| P(true)Base LLM=Llama3.1-8B2026.04 | 0.6207 | 0.7964 | |
| Eigv(Agre)-WholeBase LLM=Llama3.1-8B2026.04 | 0.594 | 0.7646 | |
| SAUP-MultipleBase LLM=Qwen2.5-7B2026.04 | 0.5641 | 0.81 | |
| MATUBase LLM=GPT-4o2026.04 | 0.5604 | 0.3384 | |
| Eigv(Agre)-finalBase LLM=Qwen2.5-7B2026.04 | 0.5537 | 0.8023 | |
| SAUP-SingleBase LLM=Llama3.1-8B2026.04 | 0.5424 | 0.7361 | |
| Eigv(Agre)-WholeBase LLM=Qwen2.5-7B2026.04 | 0.542 | 0.7995 | |
| Eigv(Agre)-finalBase LLM=GPT-4o2026.04 | 0.5365 | 0.3304 | |
| Eigv(Agre)-WholeBase LLM=GPT-4o2026.04 | 0.5341 | 0.3236 | |
| SAUP-MultipleBase LLM=Llama3.1-8B2026.04 | 0.5289 | 0.733 | |
| SAUP-SingleBase LLM=Qwen2.5-7B2026.04 | 0.5233 | 0.7749 | |
| Eigv(Agre)-finalBase LLM=Llama3.1-8B2026.04 | 0.5161 | 0.727 | |
| P(true)Base LLM=GPT-4o2026.04 | 0.5059 | 0.3183 |