# Hallucination Detection on HaluEval QA Source: [Hallucination Detection on HaluEval QA]() Collection index: [llms.txt]() Data updated: 2026-04-07T07:15:44.941Z Evaluation of model performance on hallucination detection using the HaluEval QA dataset, measured by Accuracy, Variance, and F1 Score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Hallucination Detection | | Dataset (including any stated split) | HaluEval QA | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [Variance](): Lower is better; unit: SCALAR. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | AbnorDetector-Full | 99.5 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 98.5 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 98.5 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 98 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 98 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 97.83 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 97.5 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 96.33 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 95.5 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 94.33 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 93.5 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 93.5 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 92.83 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 92.17 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 86.67 | Not recorded | 68fa77b21e209131cea74d1e | | Lynx | 86.1 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 82.83 | Not recorded | 68fa77b21e209131cea74d1e | ### AbnorDetector-Full Accuracy: 99.5. Result ID: 69d4adbb47f34ce924bc00b5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-8B-Instruct","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 98.5. Result ID: 69d4adbb47f34ce924bc00b9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-70B-Instruct","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 98.5. Result ID: 69d4adbb47f34ce924bc00ba. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-70B-Instruct","alpha (α)":"0.125","beta (β)":"0.125"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 98. Result ID: 69d4adbb47f34ce924bc00b1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-2-7b-chat","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 98. Result ID: 69d4adbb47f34ce924bc00bd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Gemma-7b-it","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 97.83. Result ID: 69d4adbb47f34ce924bc00b2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-2-7b-chat","alpha (α)":"0.125","beta (β)":"0.125"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 97.5. Result ID: 69d4adbb47f34ce924bc00be. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Gemma-7b-it","alpha (α)":"0.125","beta (β)":"0.125"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 96.33. Result ID: 69d4adbb47f34ce924bc00b7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-70B-Instruct","alpha (α)":"0.5","beta (β)":"0.5"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 95.5. Result ID: 69d4adbb47f34ce924bc00b6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-8B-Instruct","alpha (α)":"0.125","beta (β)":"0.125"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 94.33. Result ID: 69d4adbb47f34ce924bc00bc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Gemma-7b-it","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 93.5. Result ID: 69d4adbb47f34ce924bc00b3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-8B-Instruct","alpha (α)":"0.5","beta (β)":"0.5"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 93.5. Result ID: 69d4adbb47f34ce924bc00bb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Gemma-7b-it","alpha (α)":"0.5","beta (β)":"0.5"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 92.83. Result ID: 69d4adbb47f34ce924bc00af. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-2-7b-chat","alpha (α)":"0.5","beta (β)":"0.5"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 92.17. Result ID: 69d4adbb47f34ce924bc00b8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-70B-Instruct","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 86.67. Result ID: 69d4adbb47f34ce924bc00b4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-8B-Instruct","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### Lynx Accuracy: 86.1. Result ID: 69d4adbb47f34ce924bc00bf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 82.83. Result ID: 69d4adbb47f34ce924bc00b0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-2-7b-chat","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.