Semantic Hallucination Detection on PAWS
91.24AUROCHALLUGUARD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| HALLUGUARDBase Model=QwQ-32B2026.01 | 91.24 | 88.53 | |
| HALLUGUARDBase Model=Llama2-70B2026.01 | 90.18 | 87.64 | |
| RACEBase Model=QwQ-32B2026.01 | 86.38 | 83.41 | |
| HALLUGUARDBase Model=Llama-3.2-3B2026.01 | 85.63 | 82.14 | |
| InsideBase Model=Llama2-70B2026.01 | 85.47 | 82.38 | |
| InsideBase Model=QwQ-32B2026.01 | 85.41 | 82.27 | |
| MINDBase Model=QwQ-32B2026.01 | 84.56 | 81.37 | |
| RACEBase Model=Llama2-70B2026.01 | 84.26 | 81.73 | |
| MINDBase Model=Llama2-70B2026.01 | 83.92 | 81.06 | |
| SelfCheckGPTBase Model=QwQ-32B2026.01 | 83.59 | 79.42 | |
| SelfCheckGPTBase Model=Llama2-70B2026.01 | 82.71 | 78.89 | |
| InsideBase Model=Llama-3.2-3B2026.01 | 80.46 | 77.28 | |
| Semantic EntropyBase Model=QwQ-32B2026.01 | 80.42 | 77.18 | |
| RACEBase Model=Llama-3.2-3B2026.01 | 79.47 | 76.28 | |
| Semantic EntropyBase Model=Llama2-70B2026.01 | 79.06 | 76.32 | |
| MINDBase Model=Llama-3.2-3B2026.01 | 78.93 | 75.41 | |
| P(true)Base Model=QwQ-32B2026.01 | 78.53 | 75.21 | |
| EnergyBase Model=QwQ-32B2026.01 | 78.29 | 75.44 | |
| SelfCheckGPTBase Model=Llama-3.2-3B2026.01 | 77.82 | 73.41 | |
| LN EntropyBase Model=QwQ-32B2026.01 | 77.43 | 73.29 | |
| P(true)Base Model=Llama2-70B2026.01 | 77.39 | 74.18 | |
| EnergyBase Model=Llama2-70B2026.01 | 77.14 | 74.28 | |
| PerplexityBase Model=QwQ-32B2026.01 | 76.72 | 72.63 | |
| LN EntropyBase Model=Llama2-70B2026.01 | 76.23 | 72.59 | |
| PerplexityBase Model=Llama2-70B2026.01 | 75.68 | 71.42 | |
| Semantic EntropyBase Model=Llama-3.2-3B2026.01 | 75.11 | 72.41 | |
| P(true)Base Model=Llama-3.2-3B2026.01 | 73.56 | 70.43 | |
| FActScoreBase Model=QwQ-32B2026.01 | 73.46 | 68.32 | |
| EnergyBase Model=Llama-3.2-3B2026.01 | 73.05 | 70.22 | |
| FActScoreBase Model=Llama2-70B2026.01 | 72.62 | 67.58 | |
| LN EntropyBase Model=Llama-3.2-3B2026.01 | 72.19 | 68.34 | |
| PerplexityBase Model=Llama-3.2-3B2026.01 | 71.27 | 67.55 | |
| Lexical SimilarityBase Model=QwQ-32B2026.01 | 69.54 | 64.27 | |
| FActScoreBase Model=Llama-3.2-3B2026.01 | 68.44 | 63.58 | |
| Lexical SimilarityBase Model=Llama2-70B2026.01 | 68.35 | 63.44 | |
| Lexical SimilarityBase Model=Llama-3.2-3B2026.01 | 64.58 | 59.67 |