Hallucination Detection on WebQSP
82F1 ScoreKG-Guard
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| KG-GuardGraph encoder=GraphTransformer2026.05 | 82 | — | — | — | — | |
| KG-GuardGraph Architecture=GraphTransformer2026.05 | 82 | 84.9 | 81.3 | 85.9 | 91.4 | |
| KG-GuardGraph encoder=GAT2026.05 | 79.8 | — | — | — | — | |
| KG-GuardGraph Architecture=GAT2026.05 | 79.8 | 82.1 | 79.8 | 83.9 | 90.7 | |
| Most Frequent2026.05 | 65.9 | — | — | — | — | |
| Most Frequent2026.05 | 65.9 | 49.1 | 100 | 49.1 | 49.1 | |
| GPT 5 MiniInput modalities=G+RS+RT2026.05 | 59.2 | — | — | — | — | |
| GPT 5 MiniJudge Inputs=G+RS+RT2026.05 | 59.2 | 85.3 | 45.3 | 69.3 | 65.5 | |
| GPT 5 MiniInput modalities=G2026.05 | 55.9 | — | — | — | — | |
| GPT 5 MiniJudge Inputs=G2026.05 | 55.9 | 85.5 | 41.6 | 67.9 | 64.2 | |
| Random2026.05 | 49.6 | — | — | — | — | |
| Random2026.05 | 49.6 | 49.4 | 49.9 | 50.3 | 49.2 | |
| SelfCheckNumber of samples=102026.05 | 48.7 | — | — | — | — | |
| SelfCheckN=102026.05 | 48.7 | 68 | 38 | 60.8 | 56.3 | |
| SelfCheckNumber of samples=52026.05 | 42.1 | — | — | — | — | |
| SelfCheckN=52026.05 | 42.1 | 68.7 | 30.4 | 59 | 55 | |
| Llama 4 ScoutInput modalities=G+RS+RT2026.05 | 41 | — | — | — | — | |
| Llama 4 ScoutJudge Inputs=G+RS+RT2026.05 | 41 | 79.6 | 27.6 | 61 | 57.5 | |
| Llama 4 ScoutInput modalities=G2026.05 | 36.7 | — | — | — | — | |
| Llama 4 ScoutJudge Inputs=G2026.05 | 36.7 | 66.7 | 25.3 | 57.1 | 53.5 | |
| Llama 4 ScoutInput modalities=G+RS2026.05 | 36.5 | — | — | — | — | |
| Llama 4 ScoutJudge Inputs=G+RS2026.05 | 36.5 | 73.4 | 24.3 | 58.5 | 55 |