Multi-hop Reasoning on HotpotQA
67.19AUROCCoT-UQ
Evaluation Results
| Method | Links | |
|---|---|---|
| CoT-UQModel=Llama 2-13B, Strategy=AP, Base Aggregation=Probas-min2025.02 | 67.19 | |
| CoT-UQModel=Llama 2-13B, Strategy=AP, Base Aggregation=Probas-mean2025.02 | 66.56 | |
| CoT-UQModel=Llama 2-13B, Strategy=AP, Base Aggregation=TOKENSAR2025.02 | 66.29 | |
| CoT-UQModel=Llama 3.1-8B, Strategy=AP, Base Aggregation=Probas-min2025.02 | 64.37 | |
| CoT-UQModel=Llama 2-13B, Strategy=SE, Base Strategy=Self-Probing, Refinement=KEYKeywords2025.02 | 64.03 | |
| CoT-UQModel=Llama 3.1-8B, Strategy=SE, Base Strategy=P(True), Refinement=KEYKeywords2025.02 | 63.1 | |
| P(True)Model=Llama 3.1-8B, Strategy=SE2025.02 | 62.39 | |
| CoT-UQModel=Llama 3.1-8B, Strategy=AP, Base Aggregation=Probas-mean2025.02 | 62.01 | |
| CoT-UQModel=Llama 3.1-8B, Strategy=AP, Base Aggregation=TOKENSAR2025.02 | 61.07 | |
| Self-ProbingModel=Llama 2-13B, Strategy=SE2025.02 | 60.63 | |
| TOKENSAR + CoT-UQStrategy=AP, Backbone=Mistral 7B2025.02 | 58.59 | |
| Probas-minModel=Llama 3.1-8B, Strategy=AP2025.02 | 58.34 | |
| Probas-mean + CoT-UQStrategy=AP, Backbone=Mistral 7B2025.02 | 58.24 | |
| TOKENSARModel=Llama 2-13B, Strategy=AP2025.02 | 57.33 | |
| CoT-UQModel=Llama 3.1-8B, Strategy=SE, Base Strategy=Self-Probing, Refinement=KEYKeywords2025.02 | 57.2 | |
| CoT-UQModel=Llama 2-13B, Strategy=SE, Base Strategy=P(True), Refinement=KEYKeywords2025.02 | 57.1 | |
| Probas-minModel=Llama 2-13B, Strategy=AP2025.02 | 56.51 | |
| Probas-meanModel=Llama 2-13B, Strategy=AP2025.02 | 56.27 | |
| TOKENSARStrategy=AP, Backbone=Mistral 7B2025.02 | 55.62 | |
| Probas-meanStrategy=AP, Backbone=Mistral 7B2025.02 | 54.63 | |
| Self-ProbingModel=Llama 3.1-8B, Strategy=SE2025.02 | 54.33 | |
| Probas-meanModel=Llama 3.1-8B, Strategy=AP2025.02 | 53.73 | |
| TOKENSARModel=Llama 3.1-8B, Strategy=AP2025.02 | 53.57 | |
| P(True)Model=Llama 2-13B, Strategy=SE2025.02 | 51.13 | |
| P(True) + CoT-UQStrategy=SE, Backbone=Mistral 7B2025.02 | 50.18 | |
| P(True)Strategy=SE, Backbone=Mistral 7B2025.02 | 48.02 |