Hallucination Detection on Truthful-QA
74.17AccuracyAbnorDetector-Full
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AbnorDetector-FullBase LLM=Llama-3.1-70B-Instruct, alpha (α)=0.25, beta (β)=0.252025.04 | 74.17 | 0.0556 | 74.17 | |
| AbnorDetector-FullBase LLM=Llama-3.1-70B-Instruct, alpha (α)=0.125, beta (β)=0.1252025.04 | 73.67 | 0.0556 | 73.67 | |
| Lynx2025.04 | 70.2 | — | 73.91 | |
| AbnorDetector-FullBase LLM=Llama-3.1-8B-Instruct, alpha (α)=0.25, beta (β)=0.252025.04 | 68 | 0.1667 | 68 | |
| AbnorDetector-LiteBase LLM=Llama-3.1-70B-Instruct, alpha (α)=0.5, beta (β)=0.52025.04 | 67.5 | 6.5 | 66.93 | |
| AbnorDetector-FullBase LLM=Llama-2-7b-chat, alpha (α)=0.25, beta (β)=0.252025.04 | 66.67 | 2.3889 | 66.55 | |
| AbnorDetector-FullBase LLM=Llama-2-7b-chat, alpha (α)=0.125, beta (β)=0.1252025.04 | 64.17 | 0.0556 | 64.11 | |
| AbnorDetector-LiteBase LLM=Llama-3.1-70B-Instruct, alpha (α)=0.25, beta (β)=0.252025.04 | 63.5 | 6.1667 | 62.87 | |
| AbnorDetector-FullBase LLM=Gemma-7b-it, alpha (α)=0.25, beta (β)=0.252025.04 | 63 | 0.5 | 62.97 | |
| AbnorDetector-FullBase LLM=Gemma-7b-it, alpha (α)=0.125, beta (β)=0.1252025.04 | 59.5 | 0.1667 | 59.45 | |
| AbnorDetector-FullBase LLM=Llama-3.1-8B-Instruct, alpha (α)=0.125, beta (β)=0.1252025.04 | 55.33 | 0.3889 | 55.07 | |
| AbnorDetector-LiteBase LLM=Gemma-7b-it, alpha (α)=0.5, beta (β)=0.52025.04 | 55.33 | 4.3889 | 54.8 | |
| AbnorDetector-LiteBase LLM=Llama-3.1-8B-Instruct, alpha (α)=0.5, beta (β)=0.52025.04 | 55 | 3.1667 | 54.61 | |
| AbnorDetector-LiteBase LLM=Llama-3.1-8B-Instruct, alpha (α)=0.25, beta (β)=0.252025.04 | 53.83 | 6.0556 | 53.31 | |
| AbnorDetector-LiteBase LLM=Gemma-7b-it, alpha (α)=0.25, beta (β)=0.252025.04 | 51 | 1.1667 | 50.65 | |
| AbnorDetector-LiteBase LLM=Llama-2-7b-chat, alpha (α)=0.5, beta (β)=0.52025.04 | 50.83 | 2.0556 | 49.07 | |
| AbnorDetector-LiteBase LLM=Llama-2-7b-chat, alpha (α)=0.25, beta (β)=0.252025.04 | 47.17 | 10.8889 | 45.33 |