Faithfulness Hallucination Detection on LLM-AggreFact Refined
86.8Agg-CNNDeepSeek-V3.2
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DeepSeek-V3.2thinking=true2025.12 | 86.8 | 76.8 | 88 | 80.7 | 88 | 77.4 | 85.9 | 92.1 | 83.5 | 91.4 | 81.8 | |
| FaithLensbackbone=Llama-3.1-8B-Inst2025.12 | 84.9 | 79 | 89.4 | 79.6 | 92.4 | 92.1 | 86.8 | 92.2 | 85.1 | 87.2 | 85.6 | |
| FactCGparameters=435M2025.12 | 76.9 | 68.1 | 76.2 | 75.3 | 89 | 86.5 | 79.6 | 90 | 79.1 | 71.9 | 72.2 | |
| Claude-3.7-Sonnet2025.12 | 75.6 | 73.6 | 83.7 | 74.4 | 86.9 | 86 | 87 | 88 | 85.4 | 84 | 86 | |
| DeepSeek-V3.2thinking=false2025.12 | 75.5 | 65.5 | 75.4 | 74.4 | 87.9 | 72.9 | 80.8 | 91 | 65.5 | 82.9 | 72.7 | |
| GPT-4.12025.12 | 74.1 | 73.6 | 81.6 | 80.3 | 91.3 | 81.1 | 89.1 | 93.2 | 75.9 | 86.3 | 86.4 | |
| ClearCheckbackbone=Llama-3.1-8B-Inst2025.12 | 72.8 | 78.6 | 85.4 | 72.7 | 87.9 | 87 | 83.8 | 87 | 67.8 | 75.8 | 81.8 | |
| MiniCheckparameters=7B2025.12 | 70 | 72.7 | 85.6 | 72.9 | 86.8 | 89 | 86.9 | 91 | 74.3 | 77.8 | 85.9 | |
| o12025.12 | 68.3 | 76.7 | 77.1 | 72.3 | 85 | 76.1 | 79.6 | 85.9 | 65.8 | 76.1 | 78.7 | |
| o32025.12 | 67.8 | 77.2 | 83.3 | 79.6 | 86.9 | 87.7 | 80.6 | 92.2 | 82.9 | 83.8 | 82.1 | |
| Llama-3.1-405B-Inst2025.12 | 65.5 | 71.6 | 80.7 | 68.8 | 82 | 76.3 | 80.7 | 84 | 67.3 | 78.8 | 72.5 | |
| o3-mini2025.12 | 64.4 | 81.5 | 80.2 | 73 | 86 | 81.5 | 80.7 | 84.8 | 77.1 | 78.3 | 84 | |
| GPT-4o2025.12 | 62.3 | 74.9 | 78.3 | 68.3 | 86 | 75 | 81.8 | 86.9 | 71.5 | 76.9 | 77.9 | |
| AlignScoreparameters=355M2025.12 | 45.7 | 68 | 79.8 | 75 | 83.7 | 86.6 | 83.6 | 92.2 | 75.8 | 76.5 | 67.3 |