Probability Calibration on HalLoc-Instruct
0.11Object ECEHalLocalizer (InternVL + VisualBERT)
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=original, Label=neg2025.06 | 0.11 | — | — | 0.13 | 1.95 | 2 | 5.83 | 5.89 | 0.29 | 0.36 | |
| HalLocalizer (VisualBERT)Calibration Techniques=+TS, Label=neg2025.06 | 0.14 | — | — | 0.18 | 1.48 | 1.79 | 4.16 | 5.83 | 0.24 | 0.36 | |
| HalLocalizer (VisualBERT)Calibration Techniques=original, Label=neg2025.06 | 0.19 | — | — | 0.16 | 1.73 | 1.76 | 6.32 | 6.33 | 0.23 | 0.28 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=+TS, Label=neg2025.06 | 0.33 | — | — | 0.34 | 0.97 | 2.39 | 5.51 | 5.73 | 0.26 | 0.48 | |
| HalLocalizer (VisualBERT)Calibration Techniques=+TS, Label=avg2025.06 | 9.92 | — | — | 9.9 | 1.27 | 1.32 | 3.24 | 4 | 2.06 | 2.06 | |
| HalLocalizer (VisualBERT)Calibration Techniques=original, Label=avg2025.06 | 10.31 | — | — | 10.28 | 1.25 | 1.1 | 7.63 | 7.64 | 1.33 | 1.19 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=+TS, Label=avg2025.06 | 11.04 | — | — | 11.02 | 1.77 | 2.4 | 6.53 | 6.54 | 0.69 | 1.24 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=original, Label=avg2025.06 | 11.52 | — | — | 11.54 | 1.65 | 1.59 | 7.33 | 7.25 | 0.97 | 1.07 | |
| HalLocalizer (VisualBERT)Calibration Techniques=+TS, Label=pos2025.06 | 19.69 | — | — | 19.63 | 1.07 | 0.85 | 2.31 | 2.16 | 3.87 | 3.77 | |
| HalLocalizer (VisualBERT)Calibration Techniques=original, Label=pos2025.06 | 20.42 | — | — | 20.4 | 0.78 | 0.44 | 8.94 | 8.95 | 2.43 | 2.09 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=+TS, Label=pos2025.06 | 21.75 | — | — | 21.7 | 2.56 | 2.41 | 7.55 | 7.34 | 1.11 | 2 | |
| HalLocalizer (InternVL + VisualBERT)Calibration Techniques=original, Label=pos2025.06 | 22.93 | — | — | 22.95 | 1.34 | 1.19 | 8.83 | 8.61 | 1.65 | 1.78 | |
| InternVLCalibration Techniques=original, Label=pos2025.06 | — | 64.44 | 64.44 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=original, Label=neg2025.06 | — | 78.9 | 72.71 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=original, Label=avg2025.06 | — | 71.67 | 68.57 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=+TS, Label=pos2025.06 | — | 31.79 | 32.01 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=+TS, Label=neg2025.06 | — | 43.08 | 37.37 | — | — | — | — | — | — | — | |
| InternVLCalibration Techniques=+TS, Label=avg2025.06 | — | 37.44 | 34.66 | — | — | — | — | — | — | — |