# Hallucination Detection on SC-ChatGPT (AUCPR) Source: [Hallucination Detection on SC-ChatGPT (AUCPR)]() Collection index: [llms.txt]() Data updated: 2026-04-08T06:36:52.806Z Evaluation of model performance on detecting hallucinations using the SC-ChatGPT dataset, specifically measured by Area Under the Precision-Recall Curve (AUCPR). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Hallucination Detection | | Dataset (including any stated split) | SC-ChatGPT | | Metric | AUCPR | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [AUCPR](): Higher is better; unit: PERCENT. ## Recorded results | Method | AUCPR | Result date | Report paper | | --- | --- | --- | --- | | SELFCHECKGPT | 94.1 | Not recorded | 68fa7a4a1e209131cea823a4 | | SELFCHECKGPT | 92.5 | Not recorded | 68fa7a4a1e209131cea823a4 | | SELFCHECKGPT | 92 | Not recorded | 68fa7a4a1e209131cea823a4 | | SELFCHECKGPT | 91.7 | Not recorded | 68fa7a4a1e209131cea823a4 | | DIRECT | 91.5 | Not recorded | 68fa7a4a1e209131cea823a4 | | SC | 91.4 | Not recorded | 68fa7a4a1e209131cea823a4 | | DIRECT | 90.8 | Not recorded | 68fa7a4a1e209131cea823a4 | | SELFCHECKGPT | 90.6 | Not recorded | 68fa7a4a1e209131cea823a4 | | SC | 90.1 | Not recorded | 68fa7a4a1e209131cea823a4 | | SELFCHECKGPT | 90.1 | Not recorded | 68fa7a4a1e209131cea823a4 | | DIRECT | 90 | Not recorded | 68fa7a4a1e209131cea823a4 | | DIRECT | 89.6 | Not recorded | 68fa7a4a1e209131cea823a4 | | SC | 89.1 | Not recorded | 68fa7a4a1e209131cea823a4 | | SC | 88.6 | Not recorded | 68fa7a4a1e209131cea823a4 | | SC | 88.4 | Not recorded | 68fa7a4a1e209131cea823a4 | | DIRECT | 87.8 | Not recorded | 68fa7a4a1e209131cea823a4 | | DIRECT | 86.3 | Not recorded | 68fa7a4a1e209131cea823a4 | | SC | 85.9 | Not recorded | 68fa7a4a1e209131cea823a4 | ### SELFCHECKGPT AUCPR: 94.1. Result ID: 69d5f6e047f34ce924bdf801. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future context":"true"}. This record does not assert independent reproduction. ### SELFCHECKGPT AUCPR: 92.5. Result ID: 69d5f6e047f34ce924bdf807. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"Gemma 3","Future context":"true"}. This record does not assert independent reproduction. ### SELFCHECKGPT AUCPR: 92. Result ID: 69d5f6e047f34ce924bdf800. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future context":"false"}. This record does not assert independent reproduction. ### SELFCHECKGPT AUCPR: 91.7. Result ID: 69d5f6e047f34ce924bdf806. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"Gemma 3","Future context":"false"}. This record does not assert independent reproduction. ### DIRECT AUCPR: 91.5. Result ID: 69d5f6e047f34ce924bdf7ff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future context":"true"}. This record does not assert independent reproduction. ### SC AUCPR: 91.4. Result ID: 69d5f6e047f34ce924bdf803. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future context":"true"}. This record does not assert independent reproduction. ### DIRECT AUCPR: 90.8. Result ID: 69d5f6e047f34ce924bdf80b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future context":"true"}. This record does not assert independent reproduction. ### SELFCHECKGPT AUCPR: 90.6. Result ID: 69d5f6e047f34ce924bdf80d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future context":"true"}. This record does not assert independent reproduction. ### SC AUCPR: 90.1. Result ID: 69d5f6e047f34ce924bdf809. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"Gemma 3","Future context":"true"}. This record does not assert independent reproduction. ### SELFCHECKGPT AUCPR: 90.1. Result ID: 69d5f6e047f34ce924bdf80c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future context":"false"}. This record does not assert independent reproduction. ### DIRECT AUCPR: 90. Result ID: 69d5f6e047f34ce924bdf7fe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future context":"false"}. This record does not assert independent reproduction. ### DIRECT AUCPR: 89.6. Result ID: 69d5f6e047f34ce924bdf80a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future context":"false"}. This record does not assert independent reproduction. ### SC AUCPR: 89.1. Result ID: 69d5f6e047f34ce924bdf802. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"LLaMA 3.1","Future context":"false"}. This record does not assert independent reproduction. ### SC AUCPR: 88.6. Result ID: 69d5f6e047f34ce924bdf808. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"Gemma 3","Future context":"false"}. This record does not assert independent reproduction. ### SC AUCPR: 88.4. Result ID: 69d5f6e047f34ce924bdf80f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future context":"true"}. This record does not assert independent reproduction. ### DIRECT AUCPR: 87.8. Result ID: 69d5f6e047f34ce924bdf805. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"Gemma 3","Future context":"true"}. This record does not assert independent reproduction. ### DIRECT AUCPR: 86.3. Result ID: 69d5f6e047f34ce924bdf804. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"Gemma 3","Future context":"false"}. This record does not assert independent reproduction. ### SC AUCPR: 85.9. Result ID: 69d5f6e047f34ce924bdf80e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Detector":"Qwen 2.5","Future context":"false"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.