Hallucination Evaluation on ModeVent Out-of-Domain irrelevance Outliers 1.0
4.35Average Fidelity ScoreSelfCheckGPT
Evaluation results
| Method | Links | |||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SelfCheckGPTError Category=Information Sparsity2026.06 | 4.35 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.44 | 5.79 | — | — | — | |
| MODE-RAGError Category=Out-of-Domain Irrelevance2026.06 | 4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 3.14 | 7.14 | — | — | — | |
| MODE-RAGError Category=Majority Text Bias2026.06 | 3.91 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 3.45 | 7.36 | — | — | — | |
| Self-RAGError Category=Majority Text Bias2026.06 | 3.78 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 3.18 | 6.96 | — | — | — | |
| MODE-RAGError Category=Metadata Redundancy2026.06 | 3.71 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.77 | 6.49 | — | — | — | |
| MODE-RAGError Category=Information Sparsity2026.06 | 3.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.1 | 5.71 | — | — | — | |
| Self-RAGError Category=Out-of-Domain Irrelevance2026.06 | 3.55 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.74 | 6.29 | — | — | — | |
| Self-RAGError Category=Metadata Redundancy2026.06 | 3.51 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.74 | 6.25 | — | — | — | |
| MODE-RAG2026.06 | 3.39 | 2.38 | 1.64 | 4.02 | 2.78 | 2.19 | 4.97 | 3.6 | 2.1 | 5.71 | 3.91 | 3.45 | 7.36 | 3.71 | 2.77 | 6.49 | 4 | 3.14 | 7.14 | 3.3 | 2.74 | 6.04 | 2.59 | 5.98 | 1.07 | 0.41 | 1.48 | |
| MODE-RAGError Category=Average2026.06 | 3.39 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.59 | 5.98 | — | — | — | |
| WoodpeckerError Category=Causal Imposition2026.06 | 3.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 3.07 | 6.37 | — | — | — | |
| MODE-RAGError Category=Scene Misalignment2026.06 | 3.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.74 | 6.04 | — | — | — | |
| Self-RAGError Category=Scene Misalignment2026.06 | 3.27 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.42 | 5.7 | — | — | — | |
| WoodpeckerError Category=Out-of-Domain Irrelevance2026.06 | 3.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.97 | 6.21 | — | — | — | |
| Self-RAGError Category=Average2026.06 | 3.24 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.41 | 5.64 | — | — | — | |
| SelfCheckGPTError Category=Metadata Redundancy2026.06 | 3.23 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.21 | 5.44 | — | — | — | |
| WoodpeckerError Category=Majority Text Bias2026.06 | 3.11 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.76 | 5.87 | — | — | — | |
| Self-RAGError Category=Causal Imposition2026.06 | 3.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.17 | 5.23 | — | — | — | |
| WoodpeckerError Category=Scene Misalignment2026.06 | 3.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.89 | 5.91 | — | — | — | |
| WoodpeckerError Category=Average2026.06 | 2.97 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.68 | 5.65 | — | — | — | |
| MODE-RAGError Category=Causal Imposition2026.06 | 2.78 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.19 | 4.97 | — | — | — | |
| WoodpeckerError Category=Information Sparsity2026.06 | 2.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.15 | 4.9 | — | — | — | |
| WoodpeckerError Category=Metadata Redundancy2026.06 | 2.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.63 | 5.38 | — | — | — | |
| BaselineError Category=Out-of-Domain Irrelevance2026.06 | 2.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.72 | 5.46 | — | — | — | |
| Self-RAGError Category=Attribute Hijacking2026.06 | 2.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.89 | 4.59 | — | — | — | |
| Self-RAGError Category=Information Sparsity2026.06 | 2.63 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.48 | 4.11 | — | — | — | |
| BaselineError Category=Scene Misalignment2026.06 | 2.61 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.29 | 4.9 | — | — | — | |
| WoodpeckerError Category=Attribute Hijacking2026.06 | 2.56 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.15 | 4.71 | — | — | — | |
| BaselineError Category=Metadata Redundancy2026.06 | 2.53 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.41 | 4.94 | — | — | — | |
| BaselineError Category=Majority Text Bias2026.06 | 2.43 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.61 | 5.04 | — | — | — | |
| MODE-RAGError Category=Attribute Hijacking2026.06 | 2.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.64 | 4.02 | — | — | — | |
| Baseline2026.06 | 2.31 | 1.91 | 1.34 | 3.25 | 1.86 | 1.93 | 3.79 | 2.05 | 1.88 | 3.93 | 2.43 | 2.61 | 5.04 | 2.53 | 2.41 | 4.94 | 2.75 | 2.72 | 5.46 | 2.61 | 2.29 | 4.9 | 2.18 | 4.5 | — | — | — | |
| BaselineError Category=Average2026.06 | 2.31 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 2.18 | 4.5 | — | — | — | |
| SelfCheckGPTError Category=Out-of-Domain Irrelevance2026.06 | 2.14 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.41 | 2.55 | — | — | — | |
| BaselineError Category=Information Sparsity2026.06 | 2.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.88 | 3.93 | — | — | — | |
| SelfCheckGPTError Category=Average2026.06 | 1.99 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.84 | 2.83 | — | — | — | |
| BaselineError Category=Attribute Hijacking2026.06 | 1.91 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.34 | 3.25 | — | — | — | |
| BaselineError Category=Causal Imposition2026.06 | 1.86 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.93 | 3.79 | — | — | — | |
| SelfCheckGPTError Category=Attribute Hijacking2026.06 | 1.29 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.35 | 1.64 | — | — | — | |
| SelfCheckGPTError Category=Majority Text Bias2026.06 | 1.25 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 1.01 | 2.26 | — | — | — | |
| SelfCheckGPTError Category=Scene Misalignment2026.06 | 1.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.07 | 1.1 | — | — | — | |
| SelfCheckGPTError Category=Causal Imposition2026.06 | 1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 0.4 | 1.4 | — | — | — |