Hallucination Detection on Summarization
32.1PRRAttention Score
Evaluation Results
| Method | Links | |
|---|---|---|
| Attention ScoreLLM Model=GPT-OSS 20B2025.05 | 32.1 | |
| Attention ScoreLLM Model=Llama-3.1 8B-Instruct2025.05 | 23 | |
| MSPLLM Model=GPT-OSS 20B2025.05 | 22 | |
| RAUQLLM Model=GPT-OSS 20B2025.05 | 19.6 | |
| Semantic EntropyLLM Model=GPT-OSS 20B2025.05 | 19.4 | |
| MSPLLM Model=Llama-3.1 8B-Instruct2025.05 | 18.4 | |
| MTELLM Model=GPT-OSS 20B2025.05 | 18 | |
| CCPLLM Model=GPT-OSS 20B2025.05 | 17.9 | |
| CCPLLM Model=Llama-3.1 8B-Instruct2025.05 | 17.5 | |
| Semantic DensityLLM Model=GPT-OSS 20B2025.05 | 16.8 | |
| PerplexityLLM Model=GPT-OSS 20B2025.05 | 16.2 | |
| SARLLM Model=GPT-OSS 20B2025.05 | 16.2 | |
| Semantic EntropyLLM Model=Llama-3.1 8B-Instruct2025.05 | 15.2 | |
| RAUQLLM Model=Llama-3.1 8B-Instruct2025.05 | 15 | |
| MTELLM Model=Llama-3.1 8B-Instruct2025.05 | 14.4 | |
| Simple FocusLLM Model=GPT-OSS 20B2025.05 | 14.2 | |
| PerplexityLLM Model=Llama-3.1 8B-Instruct2025.05 | 13.9 | |
| SARLLM Model=Llama-3.1 8B-Instruct2025.05 | 13.8 | |
| Semantic DensityLLM Model=Llama-3.1 8B-Instruct2025.05 | 13.8 | |
| Lexical Similarity Rouge-LLLM Model=Llama-3.1 8B-Instruct2025.05 | 12.8 | |
| LUQLLM Model=Llama-3.1 8B-Instruct2025.05 | 12.1 | |
| Lexical Similarity Rouge-LLLM Model=GPT-OSS 20B2025.05 | 12 | |
| Simple FocusLLM Model=Llama-3.1 8B-Instruct2025.05 | 11.9 | |
| LUQLLM Model=GPT-OSS 20B2025.05 | 10.7 | |
| EigenScoreLLM Model=Llama-3.1 8B-Instruct2025.05 | 10.7 | |
| DegMat NLI Score entail.LLM Model=Llama-3.1 8B-Instruct2025.05 | 10.1 | |
| EVL NLI Score entail.LLM Model=Llama-3.1 8B-Instruct2025.05 | 9.3 | |
| DegMat NLI Score entail.LLM Model=GPT-OSS 20B2025.05 | 9 | |
| EVL NLI Score entail.LLM Model=GPT-OSS 20B2025.05 | 8.6 | |
| EigenScoreLLM Model=GPT-OSS 20B2025.05 | 6.8 | |
| Ecc. NLI Score entail.LLM Model=GPT-OSS 20B2025.05 | 6.7 | |
| Ecc. NLI Score entail.LLM Model=Llama-3.1 8B-Instruct2025.05 | 6 |