Error Detection on Unanswerability hallucination detection benchmarks (Average)
75.1AUCCOMET
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| COMETBackbone=Qwen3VL-2B-Instruct, Generation-free (GF)=true2026.06 | 75.1 | 69.3 | 71 | |
| COMETBackbone=InternVL3.5-1B, Generation-free (GF)=true2026.06 | 73.2 | 64.9 | 76.7 | |
| COMETBackbone=Qwen3VL-4B-Instruct, Generation-free (GF)=true2026.06 | 70.5 | 54 | 76.1 | |
| COMETBackbone=Qwen3VL-8B-Instruct, Generation-free (GF)=true2026.06 | 70.1 | 57.2 | 76.5 | |
| P(Correct)Backbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.06 | 67.2 | 61.9 | 81.7 | |
| P(Correct)Backbone=InternVL3.5-1B, Generation-free (GF)=false2026.06 | 64.9 | 55.3 | 81.2 | |
| P(Correct)Backbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.06 | 64.8 | 47.4 | 80 | |
| P(Correct)Backbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.06 | 63.5 | 46.7 | 84.4 | |
| Verbalized ConfBackbone=InternVL3.5-1B, Generation-free (GF)=false2026.06 | 61.5 | 56 | 95.4 | |
| Consist. (Ent)Backbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.06 | 61.4 | 44.2 | 88.6 | |
| Verbalized ConfBackbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.06 | 61.2 | 50.3 | 91.1 | |
| Consist. (Max)Backbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.06 | 61 | 44.1 | 88.6 | |
| Verbalized ConfBackbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.06 | 59.9 | 56.7 | 95.3 | |
| Consist. (Ent)Backbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.06 | 59.9 | 43.8 | 87.7 | |
| Consist. (Max)Backbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.06 | 59.8 | 43.4 | 90.4 | |
| Consist. (Ent)Backbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.06 | 58.6 | 51.9 | 88.6 | |
| Consist. (Max)Backbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.06 | 58.4 | 51.9 | 89.2 | |
| VL UncertaintyBackbone=InternVL3.5-1B, Generation-free (GF)=false2026.06 | 56.1 | 52.6 | 88.4 | |
| Verbalized ConfBackbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.06 | 54.8 | 39.7 | 93 | |
| NLLBackbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.06 | 54.7 | 37.7 | 94.3 | |
| VL UncertaintyBackbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.06 | 53.4 | 58.4 | 95.5 | |
| VL UncertaintyBackbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.06 | 52.2 | 38 | 97.9 | |
| VL UncertaintyBackbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.06 | 52.2 | 37.6 | 97.5 | |
| NLLBackbone=InternVL3.5-1B, Generation-free (GF)=false2026.06 | 51.4 | 43.2 | 95 | |
| NLLBackbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.06 | 50.6 | 46.5 | 96.1 | |
| NLLBackbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.06 | 49.9 | 35.3 | 96.2 | |
| Consist. (Ent)Backbone=InternVL3.5-1B, Generation-free (GF)=false2026.06 | 49.3 | 44.1 | 92.6 | |
| Consist. (Max)Backbone=InternVL3.5-1B, Generation-free (GF)=false2026.06 | 49.3 | 44.1 | 92.6 |