List your company
ResearchFormerly WizWand

Hallucination Detection on TyDiQA (test)

88.4AUROCHARP
28.18443.81759.4575.083Sep 15, 2025
Updated 7mo ago

Evaluation results

MethodLinks
HARPModels=Qwen-2.5-7B-Instruct, Single=true2025.0988.4
HARPModels=LLaMA-3.1-8B, Single=true2025.0986.6
EigenScoreModels=LLaMA-3.1-8B, Single=false2025.0982.4
EigenScoreModels=Qwen-2.5-7B-Instruct, Single=false2025.0974.8
Lexical SimilarityModels=LLaMA-3.1-8B, Single=false2025.0969.5
HaloScopeModels=Qwen-2.5-7B-Instruct, Single=true2025.0969
Semantic EntropyModels=Qwen-2.5-7B-Instruct, Single=false2025.0968.6
Semantic EntropyModels=LLaMA-3.1-8B, Single=false2025.0962.2
Lexical SimilarityModels=Qwen-2.5-7B-Instruct, Single=false2025.0960.3
PerplexityModels=LLaMA-3.1-8B, Single=true2025.0953.4
HaloScopeModels=LLaMA-3.1-8B, Single=true2025.0953.3
LN-EntropyModels=LLaMA-3.1-8B, Single=false2025.0948.8
LN-EntropyModels=Qwen-2.5-7B-Instruct, Single=false2025.0947.1
PerplexityModels=Qwen-2.5-7B-Instruct, Single=true2025.0930.5