Hallucination Detection on PubmedQA
88F1 ScoreLatentAudit
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| LatentAuditBase Model=Qwen-32026.04 | 88 | — | 94.8 | |
| GPT-4o JudgeBase Model=Llama-22026.04 | 87 | — | 94.8 | |
| GPT-4o JudgeBase Model=Llama-32026.04 | 87 | — | 94.8 | |
| GPT-4o JudgeBase Model=Qwen-2.52026.04 | 87 | — | 94.8 | |
| GPT-4o JudgeBase Model=Qwen-32026.04 | 87 | — | 94.8 | |
| GPT-4o JudgeBase Model=Mistral2026.04 | 87 | — | 94.8 | |
| LatentAuditBase Model=Llama-32026.04 | 87 | — | 94.2 | |
| LatentAuditBase Model=Llama-22026.04 | 86 | — | 93.1 | |
| LatentAuditBase Model=Qwen-2.52026.04 | 86 | — | 93.8 | |
| LatentAuditBase Model=Mistral2026.04 | 85 | — | 92.5 | |
| INSIDEBase Model=Llama-32026.04 | 84 | — | 90.8 | |
| INSIDEBase Model=Llama-22026.04 | 83 | — | 90.3 | |
| INSIDEBase Model=Qwen-32026.04 | 83 | — | 90.5 | |
| INSIDEBase Model=Qwen-2.52026.04 | 82 | — | 89.9 | |
| INSIDEBase Model=Mistral2026.04 | 82 | — | 89.5 | |
| SAPLMABase Model=Llama-32026.04 | 82 | — | 88.2 | |
| HalluCleanBackbone=GPT-3.5-turbo2025.11 | 81.7 | 81 | — | |
| SelfCheckGPTBase Model=Llama-32026.04 | 81 | — | 87.1 | |
| SAPLMABase Model=Llama-22026.04 | 81 | — | 87.8 | |
| SAPLMABase Model=Qwen-32026.04 | 81 | — | 88 | |
| SelfCheckGPTBase Model=Llama-22026.04 | 80 | — | 86.2 | |
| SelfCheckGPTBase Model=Qwen-32026.04 | 80 | — | 86.9 | |
| SAPLMABase Model=Qwen-2.52026.04 | 80 | — | 87.2 | |
| SAPLMABase Model=Mistral2026.04 | 80 | — | 87 | |
| SelfCheckGPTBase Model=Qwen-2.52026.04 | 79 | — | 85.5 | |
| SelfCheckGPTBase Model=Mistral2026.04 | 79 | — | 85.8 | |
| DeepSeek-R12025.11 | 76.4 | 79 | — | |
| DeepSeek-V32025.11 | 71 | 77.5 | — | |
| Min-PerplexityBase Model=Llama-32026.04 | 70 | — | 72.2 | |
| Min-PerplexityBase Model=Llama-22026.04 | 69 | — | 71.8 | |
| Min-PerplexityBase Model=Qwen-32026.04 | 69 | — | 72 | |
| GPT-4o-mini2025.11 | 68.7 | 74.5 | — | |
| Min-PerplexityBase Model=Qwen-2.52026.04 | 68 | — | 71.5 | |
| Min-PerplexityBase Model=Mistral2026.04 | 68 | — | 71.2 | |
| Llama-3-70B2025.11 | 16.5 | 54.5 | — | |
| GPT-3.5-turbo2025.11 | 7.7 | 52 | — |