Hallucination Detection on True-False
89.7AUCPRSELFCHECKGPT
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| SELFCHECKGPTDetector=Gemma 3, Future context=true2025.07 | 89.7 | — | — | — | — | — | — | — | |
| SELFCHECKGPTDetector=LLaMA 3.1, Future context=true2025.07 | 89.3 | — | — | — | — | — | — | — | |
| SELFCHECKGPTDetector=Gemma 3, Future context=false2025.07 | 88.8 | — | — | — | — | — | — | — | |
| SELFCHECKGPTDetector=LLaMA 3.1, Future context=false2025.07 | 88.1 | — | — | — | — | — | — | — | |
| DIRECTDetector=LLaMA 3.1, Future context=true2025.07 | 87.1 | — | — | — | — | — | — | — | |
| SELFCHECKGPTDetector=Qwen 2.5, Future context=false2025.07 | 86.5 | — | — | — | — | — | — | — | |
| SELFCHECKGPTDetector=Qwen 2.5, Future context=true2025.07 | 85.4 | — | — | — | — | — | — | — | |
| DIRECTDetector=Gemma 3, Future context=true2025.07 | 84.7 | — | — | — | — | — | — | — | |
| DIRECTDetector=LLaMA 3.1, Future context=false2025.07 | 84.5 | — | — | — | — | — | — | — | |
| DIRECTDetector=Qwen 2.5, Future context=true2025.07 | 83.9 | — | — | — | — | — | — | — | |
| DIRECTDetector=Gemma 3, Future context=false2025.07 | 83.8 | — | — | — | — | — | — | — | |
| SCDetector=Gemma 3, Future context=false2025.07 | 81.2 | — | — | — | — | — | — | — | |
| DIRECTDetector=Qwen 2.5, Future context=false2025.07 | 80.5 | — | — | — | — | — | — | — | |
| SCDetector=Gemma 3, Future context=true2025.07 | 80.4 | — | — | — | — | — | — | — | |
| SCDetector=LLaMA 3.1, Future context=true2025.07 | 75.8 | — | — | — | — | — | — | — | |
| SCDetector=LLaMA 3.1, Future context=false2025.07 | 71.4 | — | — | — | — | — | — | — | |
| SCDetector=Qwen 2.5, Future context=true2025.07 | 64.7 | — | — | — | — | — | — | — | |
| SCDetector=Qwen 2.5, Future context=false2025.07 | 63.9 | — | — | — | — | — | — | — | |
| EUBHDBackbone Model=LLaMA2-13B-Chat2024.11 | — | 56.84 | 59.19 | 58.35 | 57.76 | 55.89 | 50.96 | 56.5 | |
| LN-PPBackbone Model=LLaMA2-13B-Chat2024.11 | — | 55.38 | 55.64 | 53.97 | 58 | 59.54 | 56.12 | 56.44 | |
| MINDBackbone Model=LLaMA2-13B-Chat2024.11 | — | 49.57 | 47.05 | 43.72 | 50.11 | 49.86 | 45.02 | 47.56 | |
| MMBackbone Model=LLaMA2-13B-Chat2024.11 | — | 53.3 | 53.66 | 54.38 | 53.27 | 61.96 | 50.85 | 54.57 | |
| PRISM-MMBackbone Model=LLaMA2-13B-Chat2024.11 | — | 71.11 | 88.37 | 84.98 | 70.92 | 78.04 | 79.93 | 78.89 | |
| PRISM-SAPLMABackbone Model=LLaMA2-13B-Chat2024.11 | — | 74.05 | 89.6 | 84.35 | 69.97 | 79.18 | 82.09 | 79.87 | |
| SAPLMABackbone Model=LLaMA2-13B-Chat2024.11 | — | 65.84 | 70.65 | 67.21 | 64.72 | 80.54 | 62.53 | 68.58 |