Medical Visual Question Answering on SLAKE Closed 1.0 (test)
0ECEPlatt Scaling
Evaluation results
| Method | Links | |
|---|---|---|
| Platt ScalingBackbone=Qwen3-VL-32B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0 | |
| Isotonic Regr.Backbone=Qwen3-VL-32B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0 | |
| Hist. BinningBackbone=Qwen3-VL-32B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0 | |
| Hist. BinningBackbone=Qwen3-VL-2B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.008 | |
| Hist. BinningBackbone=InternVL3-2B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.012 | |
| HAC-GateBackbone=InternVL3-8B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.013 | |
| Isotonic Regr.Backbone=Qwen3-VL-2B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.018 | |
| Isotonic Regr.Backbone=Qwen3-VL-32B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.018 | |
| Platt ScalingBackbone=Qwen3-VL-2B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.019 | |
| HAC-PlattBackbone=Qwen3-VL-2B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.022 | |
| Platt ScalingBackbone=LLaVA-NeXT-7B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.023 | |
| HAC-PlattBackbone=LLaVA-NeXT-7B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.023 | |
| Isotonic Regr.Backbone=InternVL3-8B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.024 | |
| Hist. BinningBackbone=Qwen3-VL-32B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.03 | |
| Hist. BinningBackbone=InternVL3-8B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.03 | |
| Isotonic Regr.Backbone=Qwen3-VL-8B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.031 | |
| Isotonic Regr.Backbone=Qwen3-VL-8B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.031 | |
| Platt ScalingBackbone=Qwen3-VL-8B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.032 | |
| Hist. BinningBackbone=Qwen3-VL-8B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.033 | |
| Isotonic Regr.Backbone=InternVL3-2B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.033 | |
| HAC-GateBackbone=Qwen3-VL-32B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.034 | |
| Hist. BinningBackbone=InternVL3-38B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.037 | |
| Isotonic Regr.Backbone=LLaVA-NeXT-34B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.037 | |
| Platt ScalingBackbone=InternVL3-8B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.038 | |
| Isotonic Regr.Backbone=Qwen3-VL-2B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.04 | |
| Hist. BinningBackbone=LLaVA-NeXT-34B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.04 | |
| Hist. BinningBackbone=Qwen3-VL-8B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.041 | |
| HAC-GateBackbone=Qwen3-VL-2B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.042 | |
| Hist. BinningBackbone=Qwen3-VL-2B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.044 | |
| Isotonic Regr.Backbone=InternVL3-38B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.046 | |
| Isotonic Regr.Backbone=LLaVA-NeXT-34B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.046 | |
| Platt ScalingBackbone=Qwen3-VL-2B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.047 | |
| HAC-PlattBackbone=LLaVA-NeXT-34B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.051 | |
| Hist. BinningBackbone=LLaVA-NeXT-34B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.052 | |
| HAC-PlattBackbone=InternVL3-8B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.053 | |
| HAC-PlattBackbone=InternVL3-38B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.055 | |
| Isotonic Regr.Backbone=InternVL3-38B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.058 | |
| Platt ScalingBackbone=LLaVA-NeXT-34B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.059 | |
| Hist. BinningBackbone=InternVL3-38B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.061 | |
| Platt ScalingBackbone=LLaVA-NeXT-34B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.063 | |
| HAC-PlattBackbone=LLaVA-NeXT-34B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.063 | |
| HAC-GateBackbone=InternVL3-2B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.064 | |
| Platt ScalingBackbone=InternVL3-2B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.067 | |
| HAC-PlattBackbone=Qwen3-VL-2B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.068 | |
| Platt ScalingBackbone=InternVL3-38B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.068 | |
| HAC-GateBackbone=Qwen3-VL-8B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.069 | |
| Platt ScalingBackbone=Qwen3-VL-8B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.07 | |
| HAC-PlattBackbone=Qwen3-VL-8B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.07 | |
| Platt ScalingBackbone=Qwen3-VL-32B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.07 | |
| HAC-GateBackbone=InternVL3-38B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.07 | |
| Platt ScalingBackbone=InternVL3-38B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.071 | |
| HAC-PlattBackbone=Qwen3-VL-32B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.072 | |
| Platt ScalingBackbone=LLaVA-NeXT-7B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.072 | |
| Hist. BinningBackbone=LLaVA-NeXT-7B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.073 | |
| HAC-GateBackbone=Qwen3-VL-2B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.077 | |
| HAC-GateBackbone=InternVL3-38B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.077 | |
| HAC-PlattBackbone=LLaVA-NeXT-7B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.078 | |
| Hist. BinningBackbone=InternVL3-8B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.079 | |
| Hist. BinningBackbone=InternVL3-2B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.08 | |
| Hist. BinningBackbone=LLaVA-NeXT-7B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.082 | |
| Isotonic Regr.Backbone=InternVL3-8B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.083 | |
| HAC-GateBackbone=LLaVA-NeXT-34B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.083 | |
| Isotonic Regr.Backbone=LLaVA-NeXT-7B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.084 | |
| Isotonic Regr.Backbone=LLaVA-NeXT-7B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.085 | |
| HAC-PlattBackbone=Qwen3-VL-32B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.086 | |
| HAC-GateBackbone=Qwen3-VL-32B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.086 | |
| Platt ScalingBackbone=InternVL3-8B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.087 | |
| HAC-PlattBackbone=InternVL3-8B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.089 | |
| HAC-PlattBackbone=InternVL3-38B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.089 | |
| HAC-GateBackbone=LLaVA-NeXT-34B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.09 | |
| HAC-GateBackbone=Qwen3-VL-8B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.091 | |
| HAC-GateBackbone=InternVL3-8B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.092 | |
| HAC-PlattBackbone=Qwen3-VL-8B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.094 | |
| Isotonic Regr.Backbone=InternVL3-2B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.1 | |
| HAC-PlattBackbone=InternVL3-2B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.101 | |
| UncalibratedBackbone=InternVL3-38B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.107 | |
| HAC-GateBackbone=LLaVA-NeXT-7B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.117 | |
| Platt ScalingBackbone=InternVL3-2B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.123 | |
| UncalibratedBackbone=LLaVA-NeXT-7B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.132 | |
| HAC-GateBackbone=InternVL3-2B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.137 | |
| HAC-GateBackbone=LLaVA-NeXT-7B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.138 | |
| UncalibratedBackbone=Qwen3-VL-32B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.143 | |
| UncalibratedBackbone=Qwen3-VL-2B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.15 | |
| UncalibratedBackbone=InternVL3-38B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.154 | |
| HAC-PlattBackbone=InternVL3-2B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.156 | |
| UncalibratedBackbone=InternVL3-8B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.158 | |
| UncalibratedBackbone=InternVL3-8B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.165 | |
| UncalibratedBackbone=InternVL3-2B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.17 | |
| UncalibratedBackbone=Qwen3-VL-8B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.171 | |
| UncalibratedBackbone=InternVL3-2B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.175 | |
| UncalibratedBackbone=Qwen3-VL-32B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.197 | |
| UncalibratedBackbone=Qwen3-VL-2B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.199 | |
| UncalibratedBackbone=LLaVA-NeXT-34B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.202 | |
| UncalibratedBackbone=Qwen3-VL-8B, Confidence Source=Sampling, 5-fold CV=true2026.04 | 0.206 | |
| UncalibratedBackbone=LLaVA-NeXT-34B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.234 | |
| UncalibratedBackbone=LLaVA-NeXT-7B, Confidence Source=Verbalized, 5-fold CV=true2026.04 | 0.377 |