Hallucination detection on llava
96.5AUC ROCHALLUSHIFT++
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HALLUSHIFT++Model=llava-1.5-7b-hf2025.12 | 96.5 | 94.8 | 88.6 | |
| HALLUSHIFT++Model=Llama-3.2-11B-Vision2025.12 | 88.2 | 76.4 | 52.2 | |
| HALLUSHIFT++Model=kosmos-2-patch14-2242025.12 | 85.9 | 68.3 | 63.4 | |
| HALLUSHIFT++Model=instructblip-vicuna-7b2025.12 | 84.8 | 67.6 | 61.5 | |
| HALLUSHIFT++Model=Phi-3.5-vision-instruct2025.12 | 84.3 | 64.8 | 58.3 | |
| HALLUSHIFT++Model=Qwen2.5-VL-3B-Instruct2025.12 | 84 | 66.8 | 59.6 | |
| HALLUSHIFT++Model=paligemma-3b-mix-2242025.12 | 83.8 | 70.6 | 61.8 | |
| HALLUSHIFT++Model=Llama-3.2-11B-Vision-Instruct2025.12 | 82.8 | 67.9 | 59.6 | |
| HALLUSHIFTModel=Llama-3.2-11B-Vision2025.12 | 71.1 | 53.2 | 61.6 | |
| HALLUSHIFTModel=paligemma-3b-mix-2242025.12 | 61.7 | 57.2 | 53 | |
| HALLUSHIFTModel=llava-1.5-7b-hf2025.12 | 58.8 | 74 | 79.5 | |
| HALLUSHIFTModel=Phi-3.5-vision-instruct2025.12 | 58.4 | 47.5 | 49.5 | |
| ITIModel=paligemma-3b-mix-2242025.12 | 57.9 | 54.3 | 50.2 | |
| HALLUSHIFTModel=Qwen2.5-VL-3B-Instruct2025.12 | 55.5 | 51.7 | 44.8 | |
| HALLUSHIFTModel=kosmos-2-patch14-2242025.12 | 55.4 | 43.4 | 42.3 | |
| ITIModel=kosmos-2-patch14-2242025.12 | 51.8 | 40.2 | 39.5 | |
| HALLUSHIFTModel=Llama-3.2-11B-Vision-Instruct2025.12 | 51.6 | 34.3 | 43.3 | |
| HALLUSHIFTModel=instructblip-vicuna-7b2025.12 | 51.5 | 25 | 33.3 | |
| ITIModel=Llama-3.2-11B-Vision-Instruct2025.12 | 48.2 | 31.5 | 40.1 |