Hallucination Detection on VQA-RAD Open-Ended
83.13AUCVIHD
Evaluation results
| Method | Links | ||
|---|---|---|---|
| VIHDBackbone=Hulu-4B2026.05 | 83.13 | 72.01 | |
| VASEBackbone=Hulu-4B2026.05 | 76.98 | 69.09 | |
| VIHDBackbone=Lingshu-7B2026.05 | 73.13 | 55.84 | |
| CEBaGMLLM Backbone=MedGemma-1.5-4b-it2026.03 | 72.9 | 47.2 | |
| VASEBackbone=Lingshu-7B2026.05 | 71.45 | 48.02 | |
| CEBaGMLLM Backbone=HuatuoGPT-Vision-7B2026.03 | 70.4 | 63.1 | |
| V-LoopBackbone=Lingshu-7B2026.01 | 70 | 56.47 | |
| AvgProbMLLM Backbone=MedGemma-1.5-4b-it2026.03 | 69.1 | 47.4 | |
| VASEMLLM Backbone=LLaVA-Med-v1.5-Mistral-7B2026.03 | 68.4 | 40.2 | |
| V-LoopBackbone=InternVL3-8B2026.01 | 68.2 | 57.68 | |
| RadFlagBackbone=InternVL3-8B, Uncertainty-based=true2026.01 | 67.06 | 55.91 | |
| V-LoopBackbone=MedGemma-4B-it2026.01 | 66.32 | 66.51 | |
| RadFlagMLLM Backbone=LLaVA-Med-v1.5-Mistral-7B2026.03 | 65.8 | 40.1 | |
| CEBaGMLLM Backbone=LLaVA-Med-v1.5-Mistral-7B2026.03 | 65.8 | 39.1 | |
| SEMLLM Backbone=HuatuoGPT-Vision-7B2026.03 | 64.1 | 62.8 | |
| SEMLLM Backbone=LLaVA-Med-v1.5-Mistral-7B2026.03 | 63.8 | 40.4 | |
| AvgEntBackbone=MedGemma-4B-it2026.01 | 63.5 | 60.17 | |
| SEBackbone=MedGemma-4B-it, Uncertainty-based=true2026.01 | 63.33 | 63.03 | |
| RadFlagBackbone=MedGemma-4B-it, Uncertainty-based=true2026.01 | 62.91 | 62.87 | |
| AvgProbMLLM Backbone=LLaVA-Med-v1.5-Mistral-7B2026.03 | 62.9 | 38.6 | |
| MaxEntBackbone=MedGemma-4B-it2026.01 | 62.8 | 60.17 | |
| MaxProbBackbone=Hulu-4B2026.05 | 62.52 | 53.54 | |
| MaxEntBackbone=Hulu-4B2026.05 | 62.49 | 53.71 | |
| AvgProbBackbone=Hulu-4B2026.05 | 62.01 | 53.68 | |
| SEMLLM Backbone=MedGemma-4b-it2026.03 | 61.9 | 65.3 | |
| VASEMLLM Backbone=HuatuoGPT-Vision-7B2026.03 | 61.7 | 59.6 | |
| SEBackbone=InternVL3-8B, Uncertainty-based=true2026.01 | 61.26 | 53.89 | |
| MaxEntBackbone=InternVL3-8B2026.01 | 61.17 | 52.11 | |
| AvgEntBackbone=Hulu-4B2026.05 | 61.15 | 53.56 | |
| CEBaGMLLM Backbone=MedGemma-4b-it2026.03 | 61 | 64.8 | |
| VASEMLLM Backbone=MedGemma-4b-it2026.03 | 60.8 | 63.3 | |
| VASEMLLM Backbone=MedGemma-1.5-4b-it2026.03 | 60.1 | 40.3 | |
| RadFlagMLLM Backbone=HuatuoGPT-Vision-7B2026.03 | 59.9 | 58.4 | |
| AvgEntBackbone=InternVL3-8B2026.01 | 58.89 | 51.44 | |
| RadFlagMLLM Backbone=MedGemma-4b-it2026.03 | 58.4 | 63.6 | |
| AvgEntBackbone=Lingshu-7B2026.05 | 56.28 | 39.73 | |
| MaxEntBackbone=Lingshu-7B2026.05 | 56.27 | 39.74 | |
| AvgProbBackbone=Lingshu-7B2026.05 | 56.23 | 39.63 | |
| MaxProbBackbone=Lingshu-7B2026.05 | 56.21 | 39.67 | |
| RadFlagMLLM Backbone=MedGemma-1.5-4b-it2026.03 | 54.5 | 39.3 | |
| RadFlagBackbone=Lingshu-7B2026.05 | 53.27 | 36.33 | |
| SEMLLM Backbone=MedGemma-1.5-4b-it2026.03 | 53.2 | 37.2 | |
| SEBackbone=Lingshu-7B, Uncertainty-based=true2026.01 | 52.4 | 49.64 | |
| RadFlagBackbone=Lingshu-7B, Uncertainty-based=true2026.01 | 51.9 | 48.35 | |
| SEBackbone=Hulu-4B2026.05 | 50.89 | 51.77 | |
| AvgProbBackbone=Lingshu-7B2026.01 | 50.52 | 47.85 | |
| MaxProbBackbone=Lingshu-7B2026.01 | 50.37 | 47.69 | |
| SEBackbone=Lingshu-7B2026.05 | 50.37 | 35.93 | |
| RadFlagBackbone=Hulu-4B2026.05 | 50 | 49.3 | |
| MaxEntBackbone=Lingshu-7B2026.01 | 49.63 | 47.13 | |
| AvgEntBackbone=Lingshu-7B2026.01 | 49.48 | 47.07 | |
| AvgProbMLLM Backbone=HuatuoGPT-Vision-7B2026.03 | 43.7 | 48.1 | |
| AvgProbMLLM Backbone=MedGemma-4b-it2026.03 | 39.9 | 48 | |
| AvgProbBackbone=InternVL3-8B2026.01 | 39.88 | 42.12 | |
| MaxProbBackbone=InternVL3-8B2026.01 | 38.4 | 38.05 | |
| MaxProbBackbone=MedGemma-4B-it2026.01 | 36.86 | 45.37 | |
| AvgProbBackbone=MedGemma-4B-it2026.01 | 36.36 | 43.47 |