Hallucination Detection on MNLI (test)
100AuROCMarginal Em
Evaluation results
| Method | Links | |
|---|---|---|
| Marginal EmModel=Gemma-Instruct 4B, Pool=Max2026.02 | 100 | |
| Spilled ΔEModel=Gemma-Instruct 4B, Pool=Min2026.02 | 99.66 | |
| Marginal EmModel=Gemma-Instruct 4B, Pool=Min2026.02 | 99.01 | |
| Marginal EmModel=Gemma-Instruct 1B, Pool=Max2026.02 | 98.17 | |
| Spilled ΔEsModel=Gemma-Instruct 4B, Pool=Max2026.02 | 95.61 | |
| Spilled ΔEModel=Gemma-Instruct 1B, Pool=Min2026.02 | 92.93 | |
| Spilled ΔEsModel=Gemma-Instruct 1B, Pool=Max2026.02 | 77.48 | |
| Marginal EmModel=Gemma-Instruct 1B, Pool=Min2026.02 | 56.33 | |
| Logit EℓModel=Gemma-Instruct 1B, Pool=Max2026.02 | 49.28 | |
| Logit EℓModel=Gemma-Instruct 4B, Pool=Max2026.02 | 27 |