Multiple Choice VQA Benchmarks Average
84.2AUCCOMET
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| COMETBackbone=Qwen3VL-2B-Instruct, Generation-free (GF)=true2026.06 | 84.2 | 92.9 | 43.8 | |
| VL UncertaintyBackbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.06 | 80.2 | 90.9 | 48.2 | |
| COMETBackbone=Qwen3VL-8B-Instruct, Generation-free (GF)=true2026.06 | 78.3 | 82.5 | 65.4 | |
| COMETBackbone=Qwen3VL-4B-Instruct, Generation-free (GF)=true2026.06 | 78.2 | 84.3 | 65.5 | |
| Consist. (Ent)Backbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.06 | 77.5 | 89.9 | 56.2 | |
| Consist. (Max)Backbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.06 | 76.6 | 89.3 | 58.6 | |
| P(Correct)Backbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.06 | 73.3 | 77.1 | 72.4 | |
| P(Correct)Backbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.06 | 72.9 | 77.6 | 76.3 | |
| VL UncertaintyBackbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.06 | 72.2 | 78.9 | 68.7 | |
| VL UncertaintyBackbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.06 | 72.1 | 81.2 | 66 | |
| Candidate (Ent)Backbone=Qwen3VL-2B-Instruct, Generation-free (GF)=true2026.06 | 71.9 | 80.1 | 79.9 | |
| Consist. (Ent)Backbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.06 | 71.4 | 79.1 | 65.8 | |
| Consist. (Ent)Backbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.06 | 70.9 | 81.3 | 63.8 | |
| Consist. (Max)Backbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.06 | 70.9 | 78.1 | 68.8 | |
| Candidate (Max)Backbone=Qwen3VL-2B-Instruct, Generation-free (GF)=true2026.06 | 70.8 | 79.3 | 81.2 | |
| Consist. (Max)Backbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.06 | 70.6 | 80.7 | 67.8 | |
| Candidate (Ent)Backbone=Qwen3VL-4B-Instruct, Generation-free (GF)=true2026.06 | 68 | 67.6 | 86.1 | |
| Consist. (Ent)Backbone=InternVL3.5-1B, Generation-free (GF)=false2026.06 | 68 | 80.4 | 76.7 | |
| Candidate (Ent)Backbone=Qwen3VL-8B-Instruct, Generation-free (GF)=true2026.06 | 67.5 | 64.6 | 84.6 | |
| Consist. (Max)Backbone=InternVL3.5-1B, Generation-free (GF)=false2026.06 | 67.4 | 79.8 | 78.1 | |
| Candidate (Max)Backbone=Qwen3VL-4B-Instruct, Generation-free (GF)=true2026.06 | 67.3 | 66.4 | 88 | |
| Candidate (Max)Backbone=Qwen3VL-8B-Instruct, Generation-free (GF)=true2026.06 | 66.9 | 63.5 | 86.7 | |
| COMETBackbone=InternVL3.5-1B, Generation-free (GF)=true2026.06 | 66 | 77.2 | 85.1 | |
| Verbalized ConfBackbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.06 | 61.7 | 77.3 | 93.3 | |
| P(Correct)Backbone=InternVL3.5-1B, Generation-free (GF)=false2026.06 | 58.9 | 71.6 | 91.1 | |
| VL UncertaintyBackbone=InternVL3.5-1B, Generation-free (GF)=false2026.06 | 58.7 | 71.5 | 90.2 | |
| Candidate (Ent)Backbone=InternVL3.5-1B, Generation-free (GF)=true2026.06 | 58.3 | 65.7 | 92.1 | |
| Candidate (Max)Backbone=InternVL3.5-1B, Generation-free (GF)=true2026.06 | 57.5 | 65.1 | 92.8 | |
| Verbalized ConfBackbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.06 | 56 | 64 | 89.9 | |
| Verbalized ConfBackbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.06 | 54 | 67.6 | 91.1 | |
| Verbalized ConfBackbone=InternVL3.5-1B, Generation-free (GF)=false2026.06 | 53.1 | 69.5 | 89.2 | |
| P(Correct)Backbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.06 | 51.1 | 68.8 | 97 | |
| NLLBackbone=InternVL3.5-1B, Generation-free (GF)=false2026.06 | 35.7 | 55.8 | 99.4 | |
| NLLBackbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.06 | 30.1 | 45.2 | 98 | |
| NLLBackbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.06 | 24.7 | 44.6 | 99.6 | |
| NLLBackbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.06 | 19.1 | 55.6 | 99.6 |