Uncertainty Estimation on MoreHopQA AutoGen (test)
63.92AUROCMATU
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MATUBase LLM=Qwen2.5-7B2026.04 | 63.92 | 73.74 | |
| MATUBase LLM=Llama3.1-8B2026.04 | 59.89 | 61.17 | |
| MATUBase LLM=GPT-4o2026.04 | 58.17 | 52.37 | |
| P(true)Base LLM=Qwen2.5-7B2026.04 | 58.06 | 70.31 | |
| P(true)Base LLM=GPT-4o2026.04 | 55.98 | 50.33 | |
| P(true)Base LLM=Llama3.1-8B2026.04 | 55.15 | 58.27 | |
| SAUP-MultipleBase LLM=Llama3.1-8B2026.04 | 54.88 | 58.77 | |
| SAUP-SingleBase LLM=Llama3.1-8B2026.04 | 54.22 | 57.82 | |
| Eigv(Agre)-finalBase LLM=Llama3.1-8B2026.04 | 53.95 | 57.21 | |
| SAUP-MultipleBase LLM=Qwen2.5-7B2026.04 | 53.42 | 67.08 | |
| Eigv(Agre)-finalBase LLM=Qwen2.5-7B2026.04 | 53.31 | 66.78 | |
| Eigv(Agre)-WholeBase LLM=Qwen2.5-7B2026.04 | 53.23 | 66.89 | |
| Eigv(Agre)-finalBase LLM=GPT-4o2026.04 | 53.11 | 49.68 | |
| Eigv(Agre)-WholeBase LLM=Llama3.1-8B2026.04 | 52.79 | 56.42 | |
| Eigv(Agre)-WholeBase LLM=GPT-4o2026.04 | 52.18 | 49.42 | |
| SAUP-SingleBase LLM=Qwen2.5-7B2026.04 | 51.97 | 64.45 |