List your company

Visual Question Answering on VQA v2 (Uncertainty & Calibration Metrics)

0.883AUROCFUSE
0.714520.758260.8020.84574Jun 1, 2026

Evaluation results

MethodLinks
FUSEBackbone=CLIP-ViT-L-336px, stochastic responses (n)=502026.060.8830.6440.4370.2690.9450.9210.0370.94
Quantile θ*description=Global threshold via coverage constraint2026.060.8810.6280.4280.2510.9290.8990.0420.93
Mean-only u*description=Uses only the posterior mean2026.060.880.6420.4330.2520.9410.9190.0390.931
Logistic u*description=Fitted logistic function on calibration dataset2026.060.8770.6310.4290.2440.9340.8990.0390.926
Global Tuningdescription=Jointly tuned parameters2026.060.8720.6280.4270.2370.9110.8910.0470.919
OLS V~description=Variance fitting using least squares2026.060.8720.6290.430.2440.9350.9020.0440.918
Unweighteddescription=Unweighted semantic evidence2026.060.8640.6310.430.250.9390.9150.0390.923
UMPIREBackbone=CLIP-ViT-L-336px, stochastic responses (n)=502026.060.8620.6290.4120.230.9330.890.0420.916
EigenScoreBackbone=CLIP-ViT-L-336px, stochastic responses (n)=502026.060.850.6010.420.2150.9220.8830.0560.913
Semantic EntropyBackbone=CLIP-ViT-L-336px, stochastic responses (n)=502026.060.840.5740.3330.1770.9090.8970.0560.902
CLMBackbone=CLIP-ViT-L-336px, stochastic responses (n)=502026.060.7720.5980.3490.2110.8340.8610.0890.818
LN-EntropyBackbone=CLIP-ViT-L-336px, stochastic responses (n)=502026.060.7630.2820.1120.0570.5630.5660.0550.899
NeighborhoodBackbone=CLIP-ViT-L-336px, stochastic responses (n)=502026.060.7610.3620.170.0490.7890.7120.3310.886
LoFreeCPBackbone=CLIP-ViT-L-336px, stochastic responses (n)=502026.060.7210.5990.3920.20.8110.840.0740.842