Visual Question Answering on VQA v2 (Uncertainty & Calibration Metrics) benchmark leaderboard · SOTA2 Research

Visual Question Answering on VQA v2 (Uncertainty & Calibration Metrics)

0.883AUROCFUSE

Evaluation Results

Method	Links
FUSE2026.06		0.883	0.644	0.437	0.269	0.945	0.921	0.037	0.94
Quantile θ*2026.06		0.881	0.628	0.428	0.251	0.929	0.899	0.042	0.93
Mean-only u*2026.06		0.88	0.642	0.433	0.252	0.941	0.919	0.039	0.931
Logistic u*2026.06		0.877	0.631	0.429	0.244	0.934	0.899	0.039	0.926
Global Tuning2026.06		0.872	0.628	0.427	0.237	0.911	0.891	0.047	0.919
OLS V~2026.06		0.872	0.629	0.43	0.244	0.935	0.902	0.044	0.918
Unweighted2026.06		0.864	0.631	0.43	0.25	0.939	0.915	0.039	0.923
UMPIRE2026.06		0.862	0.629	0.412	0.23	0.933	0.89	0.042	0.916
EigenScore2026.06		0.85	0.601	0.42	0.215	0.922	0.883	0.056	0.913
Semantic Entropy2026.06		0.84	0.574	0.333	0.177	0.909	0.897	0.056	0.902
CLM2026.06		0.772	0.598	0.349	0.211	0.834	0.861	0.089	0.818
LN-Entropy2026.06		0.763	0.282	0.112	0.057	0.563	0.566	0.055	0.899
Neighborhood2026.06		0.761	0.362	0.17	0.049	0.789	0.712	0.331	0.886
LoFreeCP2026.06		0.721	0.599	0.392	0.2	0.811	0.84	0.074	0.842