List your company
ResearchFormerly WizWand

Open-ended Multimodal Understanding Benchmark Average

0.799AUCCOMET
0.462040.549520.6370.72448Jun 30, 2026
Updated 4mo ago

Evaluation results

MethodLinks
COMETBackbone=Qwen3VL-8B-Instruct, Generation-free (GF)=true2026.060.7990.7280.701
COMETBackbone=Qwen3VL-2B-Instruct, Generation-free (GF)=true2026.060.7850.7840.707
COMETBackbone=Qwen3VL-4B-Instruct, Generation-free (GF)=true2026.060.7840.6310.717
COMETBackbone=InternVL3.5-1B, Generation-free (GF)=true2026.060.7340.6470.771
P(Correct)Backbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.060.7140.6520.766
P(Correct)Backbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.060.7120.5360.837
P(Correct)Backbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.060.6850.6480.863
P(Correct)Backbone=InternVL3.5-1B, Generation-free (GF)=false2026.060.6670.5320.897
Consist. (Ent)Backbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.060.6610.4640.899
Consist. (Max)Backbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.060.660.4640.899
Consist. (Ent)Backbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.060.6570.5480.904
Consist. (Max)Backbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.060.6550.5470.904
VL UncertaintyBackbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.060.6540.6050.829
VL UncertaintyBackbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.060.6540.6650.829
VL UncertaintyBackbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.060.650.6460.852
Verbalized ConfBackbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.060.6420.5980.787
Verbalized ConfBackbone=InternVL3.5-1B, Generation-free (GF)=false2026.060.6390.5460.84
VL UncertaintyBackbone=InternVL3.5-1B, Generation-free (GF)=false2026.060.6370.5350.869
Consist. (Ent)Backbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.060.6240.5930.918
Consist. (Max)Backbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.060.6230.5930.914
Verbalized ConfBackbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.060.5910.5920.842
NLLBackbone=InternVL3.5-1B, Generation-free (GF)=false2026.060.5760.4330.949
NLLBackbone=Qwen3VL-2B-Instruct, Generation-free (GF)=false2026.060.5690.5450.963
Verbalized ConfBackbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.060.5620.3780.896
Consist. (Ent)Backbone=InternVL3.5-1B, Generation-free (GF)=false2026.060.4950.4110.959
Consist. (Max)Backbone=InternVL3.5-1B, Generation-free (GF)=false2026.060.4950.4110.959
NLLBackbone=Qwen3VL-4B-Instruct, Generation-free (GF)=false2026.060.4910.3570.974
NLLBackbone=Qwen3VL-8B-Instruct, Generation-free (GF)=false2026.060.4750.4170.97