Question Answering on CommonsenseQA (AUC, F95, AUP)
74.48AUCTAD
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| TADBackbone=Llama-3.1-8B-Instruct2026.04 | 74.48 | 73.63 | 51.26 | |
| Lookback LensBackbone=Llama-3.1-8B-Instruct2026.04 | 69.93 | 76.63 | 41.89 | |
| SIVR (Ours)Backbone=Llama-3.1-8B-Instruct2026.04 | 68.32 | 73.13 | 50.28 | |
| SIVRBackbone=Llama-3.1-8B-Instruct2026.04 | 68.32 | 73.13 | 50.28 | |
| SAPLMAModel=Ministral-8B-Instruct2026.04 | 68.01 | 79.88 | 47.81 | |
| TADmodel=Llama-3.2-3B-Instruct2026.04 | 68 | 82.8 | 53.38 | |
| SIVRmodel=Llama-3.2-3B-Instruct2026.04 | 66.57 | 90.53 | 48.59 | |
| SIVRBackbone=Llama-3.2-3B-Instruct2026.04 | 66.57 | 90.53 | 48.59 | |
| SIVRModel=Ministral-8B-Instruct2026.04 | 66.39 | 86.59 | 46.4 | |
| SIVRBackbone=Ministral-8B-Instruct2026.04 | 66.39 | 86.59 | 46.4 | |
| EnergyBackbone=Llama-3.1-8B-Instruct2026.04 | 65.27 | 87.95 | 37.84 | |
| SATMD + MSPModel=Ministral-8B-Instruct2026.04 | 64.57 | 75.57 | 34.52 | |
| SATMD + MSPmodel=Llama-3.2-3B-Instruct2026.04 | 64.04 | 87.65 | 40.16 | |
| Lookback LensModel=Ministral-8B-Instruct2026.04 | 63.53 | 89.53 | 38.2 | |
| SATMD + MSPBackbone=Llama-3.1-8B-Instruct2026.04 | 63.13 | 94.67 | 34.32 | |
| SEBackbone=Llama-3.1-8B-Instruct2026.04 | 62.46 | 79.45 | 34.27 | |
| SAPLMAmodel=Llama-3.2-3B-Instruct2026.04 | 62.45 | 90.48 | 48.56 | |
| CoE-Cmodel=Llama-3.2-3B-Instruct2026.04 | 61.38 | 91.05 | 41.7 | |
| SAPLMABackbone=Llama-3.1-8B-Instruct2026.04 | 61.37 | 78.38 | 31.75 | |
| Energymodel=Llama-3.2-3B-Instruct2026.04 | 60.82 | 86.75 | 41.75 | |
| EntropyBackbone=Llama-3.1-8B-Instruct2026.04 | 60.63 | 88.49 | 32.36 | |
| Entropymodel=Llama-3.2-3B-Instruct2026.04 | 59.87 | 86.52 | 41.38 | |
| TADModel=Ministral-8B-Instruct2026.04 | 58.93 | 87.15 | 30.66 | |
| PerplexityBackbone=Llama-3.1-8B-Instruct2026.04 | 58.8 | 88.77 | 30.52 | |
| SEModel=Ministral-8B-Instruct2026.04 | 58.39 | 89.29 | 36.64 | |
| Perplexitymodel=Llama-3.2-3B-Instruct2026.04 | 58.38 | 89.5 | 40.38 | |
| Max Probmodel=Llama-3.2-3B-Instruct2026.04 | 58.24 | 87.23 | 40.31 | |
| Max ProbBackbone=Llama-3.1-8B-Instruct2026.04 | 57.95 | 89.04 | 30.19 | |
| SEmodel=Llama-3.2-3B-Instruct2026.04 | 57.47 | 89.78 | 39.59 | |
| Temp-Scaledmodel=Llama-3.2-3B-Instruct2026.04 | 57.3 | 90.45 | 39.54 | |
| SARmodel=Llama-3.2-3B-Instruct2026.04 | 57.15 | 86.86 | 37.48 | |
| SARBackbone=Llama-3.2-3B-Instruct2026.04 | 57.15 | 86.86 | 37.48 | |
| Temp-ScaledBackbone=Llama-3.1-8B-Instruct2026.04 | 56.82 | 90.68 | 29.42 | |
| SARModel=Ministral-8B-Instruct2026.04 | 55.95 | 81.43 | 32.69 | |
| SARBackbone=Ministral-8B-Instruct2026.04 | 55.95 | 81.43 | 32.69 | |
| EntropyModel=Ministral-8B-Instruct2026.04 | 54.94 | 92.66 | 33.12 | |
| PerplexityModel=Ministral-8B-Instruct2026.04 | 54.89 | 91.12 | 32.67 | |
| Temp-ScaledModel=Ministral-8B-Instruct2026.04 | 54.4 | 89.47 | 32.29 | |
| Max ProbModel=Ministral-8B-Instruct2026.04 | 54.3 | 90.53 | 32.44 | |
| CoE-CBackbone=Llama-3.1-8B-Instruct2026.04 | 54.01 | 92.6 | 27.23 | |
| EnergyModel=Ministral-8B-Instruct2026.04 | 53.81 | 91.95 | 32.87 | |
| SARBackbone=Llama-3.1-8B-Instruct2026.04 | 53.58 | 91.78 | 37.03 | |
| SARBackbone=Llama-3.1-8B-Instruct2026.04 | 53.58 | 91.78 | 37.03 | |
| Lookback Lensmodel=Llama-3.2-3B-Instruct2026.04 | 53.37 | 89.71 | 36.83 | |
| CoE-RBackbone=Llama-3.1-8B-Instruct2026.04 | 51.3 | 93.97 | 25.31 | |
| CoE-Rmodel=Llama-3.2-3B-Instruct2026.04 | 51.2 | 94.15 | 32.52 | |
| P(True)model=Llama-3.2-3B-Instruct2026.04 | 50.06 | 91.41 | 30.58 | |
| CoE-CModel=Ministral-8B-Instruct2026.04 | 49.91 | 96.09 | 30.14 | |
| P(True)Model=Ministral-8B-Instruct2026.04 | 48.64 | 96.09 | 29.2 | |
| P(True)Backbone=Llama-3.1-8B-Instruct2026.04 | 45.09 | 91.78 | 21.41 | |
| CoE-RModel=Ministral-8B-Instruct2026.04 | 44.77 | 96.21 | 26.26 |