Hallucination Detection on HotpotQA (test)
0.9757AuROCmarginalized energy
Evaluation Results
| Method | Links | |
|---|---|---|
| marginalized energyLLM=LLaMA-Instruct, Aggregation Strategy=Min, Notation=Marginal E^m2026.02 | 0.9757 | |
| TriLensLLM=Gemma-2-9B2026.05 | 0.9433 | |
| TriLensLLM=Llama-3-8B2026.05 | 0.9425 | |
| spilled energyLLM=LLaMA-Instruct, Aggregation Strategy=Min, Notation=Spilled ΔE2026.02 | 0.93 | |
| TriLensLLM=Qwen2.5-7B2026.05 | 0.9242 | |
| Logit E^lLLM=LLaMA-Instruct, Aggregation Strategy=Max2026.02 | 0.9111 | |
| Spilled ΔEModel=Gemma-Instruct 4B, Pool=Min2026.02 | 0.891 | |
| Marginal EmModel=Gemma-Instruct 1B, Pool=Max2026.02 | 0.8687 | |
| Spilled ΔEModel=Gemma-Instruct 1B, Pool=Min2026.02 | 0.8564 | |
| ICR ProbeLLM=Gemma-2-9B2026.05 | 0.8409 | |
| Marginal EmModel=Gemma-Instruct 4B, Pool=Max2026.02 | 0.837 | |
| SAPLMALLM=Gemma-2-9B2026.05 | 0.8329 | |
| ICR ProbeLLM=Llama-3-8B2026.05 | 0.7909 | |
| ICR ProbeLLM=Qwen2.5-7B2026.05 | 0.7865 | |
| SAPLMALLM=Llama-3-8B2026.05 | 0.7768 | |
| SAPLMALLM=Qwen2.5-7B2026.05 | 0.7689 | |
| LN-EntropyLLM=Gemma-2-9B2026.05 | 0.7349 | |
| PPLLLM=Gemma-2-9B2026.05 | 0.7239 | |
| LN-EntropyLLM=Qwen2.5-7B2026.05 | 0.6913 | |
| LN-EntropyLLM=Llama-3-8B2026.05 | 0.6661 | |
| PPLLLM=Llama-3-8B2026.05 | 0.6658 | |
| SEPLLM=Llama-3-8B2026.05 | 0.6607 | |
| SEPLLM=Qwen2.5-7B2026.05 | 0.6536 | |
| Logit EℓModel=Gemma-Instruct 4B, Pool=Max2026.02 | 0.6284 | |
| Marginal EmModel=Gemma-Instruct 4B, Pool=Min2026.02 | 0.6259 | |
| Logit EℓModel=Gemma-Instruct 1B, Pool=Max2026.02 | 0.6224 | |
| SEPLLM=Gemma-2-9B2026.05 | 0.6149 | |
| PPLLLM=Qwen2.5-7B2026.05 | 0.6069 | |
| Orgad et al.LLM=LLaMA-Instruct, Aggregation Strategy=Mean2026.02 | 0.59 | |
| p(true)LLM=LLaMA-Instruct2026.02 | 0.5831 | |
| LLM-CheckLLM=Llama-3-8B2026.05 | 0.5559 | |
| LLM-CheckLLM=Qwen2.5-7B2026.05 | 0.5518 | |
| LLM-CheckLLM=Gemma-2-9B2026.05 | 0.5102 | |
| Spilled ΔEsModel=Gemma-Instruct 4B, Pool=Max2026.02 | 0.5087 | |
| Spilled ΔEsModel=Gemma-Instruct 1B, Pool=Max2026.02 | 0.4918 | |
| Marginal EmModel=Gemma-Instruct 1B, Pool=Min2026.02 | 0.4158 | |
| spilled energyLLM=LLaMA-Instruct, Aggregation Strategy=Max, Notation=Spilled ΔEs2026.02 | 0.3628 | |
| marginalized energyLLM=LLaMA-Instruct, Aggregation Strategy=Max, Notation=Marginal E^m2026.02 | 0.3074 |