Hallucination Detection on TyDiQA-GP
0.9404AUC ROCHaloScope
Evaluation Results
| Method | Links | |
|---|---|---|
| HaloScopeModel=LLaMA-2-7B2025.12 | 0.9404 | |
| HALLUSHIFT++Model=LLaMA-2-7B2025.12 | 0.8966 | |
| HALLUSHIFTModel=LLaMA-2-7B2025.12 | 0.8761 | |
| HALLUSHIFT++Model=OPT-6.7B2025.12 | 0.8758 | |
| HALLUSHIFTModel=OPT-6.7B2025.12 | 0.8511 | |
| HaloScopeModel=OPT-6.7B2025.12 | 0.8098 | |
| CCS*Model=LLaMA-2-7B2025.12 | 0.8038 | |
| EigenScoreBackbone=LLaMA-3-8B-Instruct2026.05 | 0.7463 | |
| FLaG (Full)Backbone=LLaMA-3-8B-Instruct2026.05 | 0.7441 | |
| Self-evaluationBackbone=LLaMA-3-8B-Instruct2026.05 | 0.7427 | |
| HaloScopeBackbone=LLaMA-3-8B-Instruct2026.05 | 0.7408 | |
| EarlyDetecBackbone=LLaMA-3-8B-Instruct2026.05 | 0.7288 | |
| FLaG (Semi)Backbone=LLaMA-3-8B-Instruct2026.05 | 0.7227 | |
| FLaG (Full)Backbone=Qwen2.5-7B-Instruct2026.05 | 0.7205 | |
| CCSBackbone=LLaMA-3-8B-Instruct2026.05 | 0.7202 | |
| Linear probeBackbone=Qwen2.5-7B-Instruct2026.05 | 0.7146 | |
| EGHBackbone=LLaMA-3-8B-Instruct2026.05 | 0.7124 | |
| TTPDBackbone=Qwen2.5-7B-Instruct2026.05 | 0.7063 | |
| Linear probeBackbone=LLaMA-3-8B-Instruct2026.05 | 0.7062 | |
| TSVBackbone=LLaMA-3-8B-Instruct2026.05 | 0.7015 | |
| EarlyDetecBackbone=Qwen2.5-7B-Instruct2026.05 | 0.6995 | |
| TTPDBackbone=LLaMA-3-8B-Instruct2026.05 | 0.6919 | |
| SAPLMABackbone=LLaMA-3-8B-Instruct2026.05 | 0.6903 | |
| SPUQBackbone=LLaMA-3-8B-Instruct2026.05 | 0.674 | |
| Probe-LRBackbone=LLaMA-3-8B-Instruct2026.05 | 0.6708 | |
| FLaG (Semi)Backbone=Qwen2.5-7B-Instruct2026.05 | 0.6702 | |
| SAPLMABackbone=Qwen2.5-7B-Instruct2026.05 | 0.6674 | |
| HaloScopeBackbone=Qwen2.5-7B-Instruct2026.05 | 0.6622 | |
| Probe-LRBackbone=Qwen2.5-7B-Instruct2026.05 | 0.662 | |
| TSVBackbone=Qwen2.5-7B-Instruct2026.05 | 0.6583 | |
| CCS*Model=OPT-6.7B2025.12 | 0.6462 | |
| EGHBackbone=Qwen2.5-7B-Instruct2026.05 | 0.6417 | |
| Lexical SimilarityBackbone=LLaMA-3-8B-Instruct2026.05 | 0.6266 | |
| EigenScoreBackbone=Qwen2.5-7B-Instruct2026.05 | 0.6248 | |
| Lexical SimilarityBackbone=Qwen2.5-7B-Instruct2026.05 | 0.6198 | |
| SPUQBackbone=Qwen2.5-7B-Instruct2026.05 | 0.6124 | |
| Self-evaluationBackbone=Qwen2.5-7B-Instruct2026.05 | 0.5759 | |
| SelfCKGPTBackbone=Qwen2.5-7B-Instruct2026.05 | 0.5601 | |
| Semantic EntropyBackbone=LLaMA-3-8B-Instruct2026.05 | 0.5569 | |
| CCSBackbone=Qwen2.5-7B-Instruct2026.05 | 0.5544 | |
| VerbalizeBackbone=LLaMA-3-8B-Instruct2026.05 | 0.5486 | |
| VerbalizeBackbone=Qwen2.5-7B-Instruct2026.05 | 0.5365 | |
| SelfCKGPTBackbone=LLaMA-3-8B-Instruct2026.05 | 0.5283 | |
| PerplexityBackbone=LLaMA-3-8B-Instruct2026.05 | 0.5225 | |
| Semantic EntropyBackbone=Qwen2.5-7B-Instruct2026.05 | 0.5021 | |
| PerplexityBackbone=Qwen2.5-7B-Instruct2026.05 | 0.4913 |