Probability Calibration on HalLoc-VQA
4.28Object ECEHalLocalizer (VisualBERT)
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| HalLocalizer (VisualBERT)Calibration Techniques=+TS, Label=neg2025.06 | 4.28 | — | — | 4.66 | 3.45 | 5.3 | 5.77 | 6.15 | 0.68 | 1.02 | |
| HalLocalizer (VisualBERT)Calibration Techniques=original, Label=neg2025.06 | 5.36 | — | — | 5.41 | 6.12 | 6.13 | 7.1 | 7.16 | 0.96 | 0.97 | |
| HalLocalizer (VisualBERT)Calibration Techniques=+TS, Label=avg2025.06 | 15.81 | — | — | 15.97 | 8.3 | 9.6 | 14.9 | 15.07 | 9.2 | 8.56 | |
| HalLocalizer (VisualBERT)Calibration Techniques=original, Label=avg2025.06 | 18.16 | — | — | 18.05 | 12.04 | 12.15 | 17.3 | 17.4 | 10.69 | 10.08 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=+TS, Label=pos2025.06 | 18.8 | — | — | 18.36 | 6.8 | 7 | 24.83 | 24.66 | 2.23 | 2.2 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=+TS, Label=avg2025.06 | 19.72 | — | — | 19.62 | 7.83 | 9.12 | 17.13 | 17.24 | 1.73 | 1.95 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=+TS, Label=neg2025.06 | 20.64 | — | — | 20.87 | 8.86 | 11.25 | 9.43 | 9.82 | 1.22 | 1.69 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=original, Label=pos2025.06 | 20.92 | — | — | 20.8 | 0.86 | 1.37 | 28.71 | 28.48 | 3.23 | 3.02 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=original, Label=avg2025.06 | 21.45 | — | — | 21.41 | 6.5 | 6.78 | 20.11 | 20 | 2.45 | 2.38 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=original, Label=neg2025.06 | 21.98 | — | — | 22.03 | 12.13 | 12.19 | 11.5 | 11.53 | 1.67 | 1.75 | |
| HalLocalizer (VisualBERT)Calibration Techniques=+TS, Label=pos2025.06 | 27.34 | — | — | 27.29 | 13.15 | 13.89 | 24.03 | 23.99 | 17.72 | 16.11 | |
| HalLocalizer (VisualBERT)Calibration Techniques=original, Label=pos2025.06 | 30.97 | — | — | 30.68 | 17.96 | 18.17 | 27.51 | 27.64 | 20.42 | 19.2 | |
| InternVLCalibration Techniques=original, Label=pos2025.06 | — | 73.72 | 67.21 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=original, Label=neg2025.06 | — | 91.6 | 78.17 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=original, Label=avg2025.06 | — | 82.66 | 72.69 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=+TS, Label=pos2025.06 | — | 39.25 | 38.67 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=+TS, Label=neg2025.06 | — | 53.31 | 44.47 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=+TS, Label=avg2025.06 | — | 46.28 | 41.57 | — | — | — | — | — | — | — |