Probability Calibration on HalLoc-Caption (test)
0.04Object ECEHalLocalizer (InternVL + VisualBERT)
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=original, Label=neg2025.06 | 0.04 | — | — | 0.08 | 0.57 | 0.54 | 0.17 | 0.13 | 0.1 | 0.1 | |
| HalLocalizer (VisualBERT)Calibration Techniques=original, Label=neg2025.06 | 0.14 | — | — | 0.18 | 0.11 | 0.16 | 0.2 | 0.24 | 0.02 | 0.02 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=+TS, Label=neg2025.06 | 0.29 | — | — | 0.27 | 0.59 | 0.56 | 0.63 | 0.6 | 0.39 | 0.39 | |
| HalLocalizer (VisualBERT)Calibration Techniques=+TS, Label=neg2025.06 | 0.45 | — | — | 0.4 | 0.24 | 0.21 | 0.3 | 0.26 | 0.17 | 0.16 | |
| HalLocalizer (VisualBERT)Calibration Techniques=+TS, Label=avg2025.06 | 8.74 | — | — | 8.67 | 14.61 | 14.6 | 9.54 | 8.74 | 10.31 | 10.81 | |
| HalLocalizer (VisualBERT)Calibration Techniques=original, Label=avg2025.06 | 10.88 | — | — | 10.79 | 15.71 | 15.73 | 10.75 | 9.85 | 11.02 | 12.04 | |
| HalLocalizer (VisualBERT)Calibration Techniques=+TS, Label=pos2025.06 | 17.03 | — | — | 16.95 | 28.98 | 28.99 | 18.77 | 17.22 | 20.45 | 21.46 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=+TS, Label=avg2025.06 | 17.32 | — | — | 17.3 | 25.91 | 25.62 | 20.66 | 23.21 | 40.12 | 40.08 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=original, Label=avg2025.06 | 18.66 | — | — | 18.61 | 25.96 | 25.67 | 22.12 | 24.57 | 41.04 | 40.99 | |
| HalLocalizer (VisualBERT)Calibration Techniques=original, Label=pos2025.06 | 21.61 | — | — | 21.41 | 31.3 | 31.3 | 21.31 | 19.46 | 22.02 | 24.05 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=+TS, Label=pos2025.06 | 34.34 | — | — | 34.32 | 51.22 | 50.68 | 40.68 | 45.81 | 79.86 | 79.76 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=original, Label=pos2025.06 | 37.29 | — | — | 37.13 | 51.34 | 50.8 | 44.07 | 49 | 81.98 | 81.88 | |
| InternVLCalibration Techniques=original, Label=pos2025.06 | — | 46.47 | 46.47 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=original, Label=neg2025.06 | — | 64.86 | 46.61 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=original, Label=avg2025.06 | — | 55.66 | 46.54 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=+TS, Label=pos2025.06 | — | 16.51 | 15.57 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=+TS, Label=neg2025.06 | — | 31.63 | 14.16 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=+TS, Label=avg2025.06 | — | 24.07 | 14.87 | — | — | — | — | — | — | — |