Hallucination Detection on SQuAD (test)
83.8AUROCrHALLUGUARD
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| HALLUGUARDBackbone=Llama2-70B2026.01 | 83.8 | 81.77 | 70.46 | 73.24 | |
| HALLUGUARDBackbone=Llama2-13B2026.01 | 81.45 | 78.39 | 64.39 | 65.07 | |
| InsideBackbone=Llama2-70B2026.01 | 81.24 | 75.09 | 69.48 | 62.4 | |
| HALLUGUARDBackbone=Llama2-7B2026.01 | 81.05 | 77.16 | 71.18 | 64.38 | |
| HALLUGUARDBackbone=Llama-3-8B2026.01 | 79.56 | 78.29 | 67.97 | 63.27 | |
| InsideBackbone=Llama-3-8B2026.01 | 76.13 | 72.44 | 65.62 | 62.94 | |
| InsideBackbone=Llama2-13B2026.01 | 74.68 | 74.81 | 61.01 | 59.51 | |
| PerplexityBackbone=Llama2-70B2026.01 | 74.23 | 70.88 | 62.24 | 58.05 | |
| SelfCheckGPTBackbone=Llama-3-8B2026.01 | 73.99 | 72.15 | 65.26 | 54.02 | |
| InsideBackbone=Llama2-7B2026.01 | 73.63 | 75.74 | 65.22 | 59.11 | |
| MINDBackbone=Llama2-70B2026.01 | 73.46 | 71.71 | 57.76 | 56.77 | |
| SelfCheckGPTBackbone=Llama2-70B2026.01 | 73.07 | 70.49 | 56.59 | 54.65 | |
| LN-EntropyBackbone=Llama2-70B2026.01 | 72.44 | 68.91 | 56.77 | 52.63 | |
| Semantic Ent.Backbone=Llama2-70B2026.01 | 72.01 | 68.51 | 56.49 | 50.9 | |
| P(true)Backbone=Llama2-13B2026.01 | 71.56 | 68.4 | 57.51 | 45.66 | |
| RACEBackbone=Llama2-7B2026.01 | 71.35 | 69.23 | 59.18 | 54.73 | |
| FActScoreBackbone=Llama-3-8B2026.01 | 71.2 | 69.45 | 61.92 | 54.91 | |
| Semantic Ent.Backbone=Llama2-13B2026.01 | 70.58 | 67.22 | 53.31 | 52.94 | |
| PerplexityBackbone=Llama-3-8B2026.01 | 70.51 | 67.51 | 55.71 | 52.68 | |
| FActScoreBackbone=Llama2-7B2026.01 | 70.32 | 68.63 | 58.13 | 53.01 | |
| Lexical Sim.Backbone=Llama2-7B2026.01 | 70.31 | 69.08 | 53.97 | 53.31 | |
| PerplexityBackbone=Llama2-13B2026.01 | 70.19 | 69.22 | 60.33 | 54.82 | |
| EnergyBackbone=Llama2-70B2026.01 | 69.01 | 66.19 | 58.44 | 49.82 | |
| Lexical Sim.Backbone=Llama2-70B2026.01 | 68.95 | 67.91 | 60.52 | 56.56 | |
| MINDBackbone=Llama2-13B2026.01 | 68.64 | 66.95 | 54.92 | 52.49 | |
| Lexical Sim.Backbone=Llama2-13B2026.01 | 68.53 | 67.42 | 50.73 | 54.12 | |
| FActScoreBackbone=Llama2-70B2026.01 | 68.33 | 65.26 | 56.93 | 48.46 | |
| SelfCheckGPTBackbone=Llama2-7B2026.01 | 68.26 | 67.09 | 60.06 | 57.31 | |
| RACEBackbone=Llama-3-8B2026.01 | 68.17 | 66.02 | 54.65 | 53.06 | |
| P(true)Backbone=Llama-3-8B2026.01 | 67.42 | 63.94 | 55.35 | 47.52 | |
| P(true)Backbone=Llama2-70B2026.01 | 66.81 | 62.71 | 57.43 | 46.85 | |
| FActScoreBackbone=Llama2-13B2026.01 | 66.65 | 63.2 | 56.41 | 53.42 | |
| Semantic Ent.Backbone=Llama-3-8B2026.01 | 66.52 | 62.62 | 52.37 | 52.7 | |
| Lexical Sim.Backbone=Llama-3-8B2026.01 | 66.43 | 63.56 | 53.19 | 50.96 | |
| LN-EntropyBackbone=Llama2-7B2026.01 | 65.96 | 64.22 | 53.43 | 52.84 | |
| SelfCheckGPTBackbone=Llama2-13B2026.01 | 65.47 | 61.65 | 53.12 | 49.89 | |
| MINDBackbone=Llama2-7B2026.01 | 64.57 | 61.11 | 52.39 | 53.13 | |
| EnergyBackbone=Llama-3-8B2026.01 | 64.41 | 61.02 | 56.17 | 46.21 | |
| RACEBackbone=Llama2-13B2026.01 | 64.19 | 60.45 | 47.53 | 45.66 | |
| RACEBackbone=Llama2-70B2026.01 | 64.05 | 62.39 | 54.38 | 50.07 | |
| PerplexityBackbone=Llama2-7B2026.01 | 63.93 | 61.77 | 46.97 | 48.2 | |
| LN-EntropyBackbone=Llama-3-8B2026.01 | 63.7 | 60.4 | 46.19 | 42.85 | |
| P(true)Backbone=Llama2-7B2026.01 | 62.55 | 61.09 | 46.84 | 52.32 | |
| MINDBackbone=Llama-3-8B2026.01 | 62.29 | 59.58 | 44.49 | 48.61 | |
| LN-EntropyBackbone=Llama2-13B2026.01 | 61.66 | 59.16 | 49.05 | 46.27 | |
| EnergyBackbone=Llama2-13B2026.01 | 61.02 | 59.73 | 48.26 | 42.08 | |
| Semantic Ent.Backbone=Llama2-7B2026.01 | 60.29 | 57.73 | 43.63 | 48.83 | |
| EnergyBackbone=Llama2-7B2026.01 | 59.83 | 56.11 | 46.19 | 43.18 |