# Hallucination Detection on SciQ (Accuracy, F1) Source: [Hallucination Detection on SciQ (Accuracy, F1)]() Collection index: [llms.txt]() Data updated: 2026-04-07T07:15:45.001Z Evaluation of model performance on hallucination detection using the SciQ dataset, specifically reporting Accuracy, Variance, and F1 Score. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Hallucination Detection | | Dataset (including any stated split) | SciQ | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 17 of 17 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [Variance](): Lower is better; unit: OTHER. - [F1 Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | AbnorDetector-Full | 96 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 94.83 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 93.5 | Not recorded | 68fa77b21e209131cea74d1e | | Lynx | 92.2 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 91.83 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 91.67 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 91.5 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 88.83 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 88.33 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Full | 88 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 86.17 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 85.17 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 74.83 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 74.5 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 73 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 70.83 | Not recorded | 68fa77b21e209131cea74d1e | | AbnorDetector-Lite | 66.83 | Not recorded | 68fa77b21e209131cea74d1e | ### AbnorDetector-Full Accuracy: 96. Result ID: 69d4adbb47f34ce924bc00dc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-70B-Instruct","alpha (α)":"0.125","beta (β)":"0.125"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 94.83. Result ID: 69d4adbb47f34ce924bc00db. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-70B-Instruct","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 93.5. Result ID: 69d4adbb47f34ce924bc00d7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-8B-Instruct","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### Lynx Accuracy: 92.2. Result ID: 69d4adbb47f34ce924bc00e1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: Not recorded. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 91.83. Result ID: 69d4adbb47f34ce924bc00d3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-2-7b-chat","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 91.67. Result ID: 69d4adbb47f34ce924bc00df. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Gemma-7b-it","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 91.5. Result ID: 69d4adbb47f34ce924bc00d4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-2-7b-chat","alpha (α)":"0.125","beta (β)":"0.125"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 88.83. Result ID: 69d4adbb47f34ce924bc00d8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-8B-Instruct","alpha (α)":"0.125","beta (β)":"0.125"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 88.33. Result ID: 69d4adbb47f34ce924bc00d9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-70B-Instruct","alpha (α)":"0.5","beta (β)":"0.5"}. This record does not assert independent reproduction. ### AbnorDetector-Full Accuracy: 88. Result ID: 69d4adbb47f34ce924bc00e0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Gemma-7b-it","alpha (α)":"0.125","beta (β)":"0.125"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 86.17. Result ID: 69d4adbb47f34ce924bc00da. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-70B-Instruct","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 85.17. Result ID: 69d4adbb47f34ce924bc00d5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-8B-Instruct","alpha (α)":"0.5","beta (β)":"0.5"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 74.83. Result ID: 69d4adbb47f34ce924bc00d6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-3.1-8B-Instruct","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 74.5. Result ID: 69d4adbb47f34ce924bc00dd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Gemma-7b-it","alpha (α)":"0.5","beta (β)":"0.5"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 73. Result ID: 69d4adbb47f34ce924bc00d1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-2-7b-chat","alpha (α)":"0.5","beta (β)":"0.5"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 70.83. Result ID: 69d4adbb47f34ce924bc00de. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Gemma-7b-it","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. ### AbnorDetector-Lite Accuracy: 66.83. Result ID: 69d4adbb47f34ce924bc00d2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Base LLM":"Llama-2-7b-chat","alpha (α)":"0.25","beta (β)":"0.25"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.