Uncertainty Estimation on PopQA
83.09A1EigV+MCH
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| EigV+MCHBase Model=Llama2-chat, Retriever=Contriver, Calibration=MCH2025.05 | 83.09 | 24.66 | 96.75 | 32.82 | 72.18 | |
| EigV+CTIBase Model=Llama2-chat, Retriever=Contriver, Calibration=CTI2025.05 | 80.8 | 19.18 | 93.5 | 29.77 | 61.51 | |
| ECC+MCHBase Model=Llama2-chat, Retriever=Contriver, Calibration=MCH2025.05 | 79.37 | 21.92 | 94.84 | 35.87 | 71.39 | |
| ECC+CTIBase Model=Llama2-chat, Retriever=Contriver, Calibration=CTI2025.05 | 78.8 | 23.29 | 90.82 | 34.35 | 61.75 | |
| SE+CTIBase Model=Llama2-chat, Retriever=Contriver, Calibration=CTI2025.05 | 78.51 | 26.03 | 91.21 | 26.72 | 62.58 | |
| SE+MCHBase Model=Llama2-chat, Retriever=Contriver, Calibration=MCH2025.05 | 77.94 | 31.51 | 94.07 | 41.22 | 72.49 | |
| EigV+NLIBase Model=Llama2-chat, Retriever=Contriver, Calibration=NLI2025.05 | 73.35 | 35.62 | 95.6 | 38.17 | 67.6 | |
| SEBase Model=Llama2-chat, Retriever=Contriver, Calibration=None2025.05 | 71.92 | 31.51 | 94.07 | 29.01 | 63.79 | |
| SE+NLIBase Model=Llama2-chat, Retriever=Contriver, Calibration=NLI2025.05 | 71.63 | 38.36 | 92.73 | 41.22 | 67.86 | |
| ECC+NLIBase Model=Llama2-chat, Retriever=Contriver, Calibration=NLI2025.05 | 71.35 | 32.88 | 92.16 | 42.75 | 66.44 | |
| PE+CTIBase Model=Llama2-chat, Retriever=Contriver, Calibration=CTI2025.05 | 69.63 | 39.73 | 87.95 | 38.17 | 63.04 | |
| PE+MCHBase Model=Llama2-chat, Retriever=Contriver, Calibration=MCH2025.05 | 69.34 | 39.73 | 89.48 | 39.7 | 64.31 | |
| PE+NLIBase Model=Llama2-chat, Retriever=Contriver, Calibration=NLI2025.05 | 68.77 | 41.1 | 88.15 | 41.22 | 63.09 | |
| PEBase Model=Llama2-chat, Retriever=Contriver, Calibration=None2025.05 | 68.18 | 42.46 | 87.57 | 38.17 | 61.59 | |
| EigVBase Model=Llama2-chat, Retriever=Contriver, Calibration=None2025.05 | 55.3 | 6.85 | 92.93 | 20.61 | 62.42 | |
| ECCBase Model=Llama2-chat, Retriever=Contriver, Calibration=None2025.05 | 52.44 | 6.84 | 87.38 | 18.32 | 62.06 |