List your company
ResearchFormerly WizWand

Hallucination Detection on NQ Open (test)

89.4AUROCHARP
48.73659.29369.8580.407Sep 15, 2025
Updated 7mo ago

Evaluation results

MethodLinks
HARPModels=LLaMA-3.1-8B, Single=true2025.0989.4
HARPModels=Qwen-2.5-7B-Instruct, Single=true2025.0984
EigenScoreModels=Qwen-2.5-7B-Instruct, Single=false2025.0978.9
Lexical SimilarityModels=Qwen-2.5-7B-Instruct, Single=false2025.0977.8
LN-EntropyModels=Qwen-2.5-7B-Instruct, Single=false2025.0977.7
Semantic EntropyModels=Qwen-2.5-7B-Instruct, Single=false2025.0977.7
PerplexityModels=Qwen-2.5-7B-Instruct, Single=true2025.0976.5
HaloScopeModels=LLaMA-3.1-8B, Single=true2025.0962.7
Lexical SimilarityModels=LLaMA-3.1-8B, Single=false2025.0960.9
HaloScopeModels=Qwen-2.5-7B-Instruct, Single=true2025.0960.7
Semantic EntropyModels=LLaMA-3.1-8B, Single=false2025.0960.7
EigenScoreModels=LLaMA-3.1-8B, Single=false2025.0956.7
LN-EntropyModels=LLaMA-3.1-8B, Single=false2025.0952.7
PerplexityModels=LLaMA-3.1-8B, Single=true2025.0950.3