Confidence Estimation on VLCB Pooled Aggregate (test)
4.29ECEInternalInspector
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| InternalInspectorLVLM Backbone=Gemma-3-27B-IT2026.05 | 4.29 | 19.68 | 83.17 | 74.15 | |
| SAPLMALVLM Backbone=Gemma-3-27B-IT2026.05 | 4.61 | 19.42 | 83.83 | 75.45 | |
| InternalInspectorLVLM Backbone=Qwen3-VL-8B-Instruct2026.05 | 5.43 | 16.95 | 89.75 | 79.6 | |
| BICRLVLM Backbone=LLaVA-NeXT-Vicuna-13B2026.05 | 5.65 | 18.16 | 87.74 | 78.94 | |
| BICRLVLM Backbone=DeepSeek-VL22026.05 | 6.02 | 17.9 | 86.19 | 81.11 | |
| BICRLVLM Backbone=Gemma-3-27B-IT2026.05 | 6.98 | 19.56 | 85.1 | 76.56 | |
| BICRLVLM Backbone=Cross-LVLM Average2026.05 | 7.09 | 18.41 | 87.47 | 78.63 | |
| InternalInspectorLVLM Backbone=DeepSeek-VL22026.05 | 7.39 | 18.95 | 84.54 | 79.31 | |
| P(I Know)LVLM Backbone=Qwen3-VL-8B-Instruct2026.05 | 7.54 | 17.99 | 88.43 | 77.19 | |
| CCPSLVLM Backbone=DeepSeek-VL22026.05 | 7.7 | 22.14 | 76.97 | 70.94 | |
| BICRLVLM Backbone=InternVL3.5-14B2026.05 | 7.9 | 19.04 | 88.04 | 76.39 | |
| InternalInspectorLVLM Backbone=Cross-LVLM Average2026.05 | 8.3 | 19.88 | 84.31 | 74.85 | |
| P(I Know)LVLM Backbone=DeepSeek-VL22026.05 | 8.5 | 19.26 | 84.58 | 78.49 | |
| P(I Know)LVLM Backbone=Gemma-3-27B-IT2026.05 | 8.88 | 19.86 | 85.07 | 76.08 | |
| BICRLVLM Backbone=Qwen3-VL-8B-Instruct2026.05 | 8.91 | 17.4 | 90.26 | 80.14 | |
| CCPSLVLM Backbone=Gemma-3-27B-IT2026.05 | 8.98 | 22.14 | 73.37 | 68.49 | |
| P(I Know)LVLM Backbone=Cross-LVLM Average2026.05 | 9.31 | 19.43 | 86.3 | 76.57 | |
| SAPLMALVLM Backbone=Qwen3-VL-8B-Instruct2026.05 | 10.57 | 19.43 | 86.41 | 74.22 | |
| InternalInspectorLVLM Backbone=InternVL3.5-14B2026.05 | 10.59 | 21.48 | 82.64 | 69.31 | |
| P(I Know)LVLM Backbone=LLaVA-NeXT-Vicuna-13B2026.05 | 10.81 | 19.87 | 87.06 | 77.32 | |
| P(I Know)LVLM Backbone=InternVL3.5-14B2026.05 | 10.83 | 20.16 | 86.35 | 73.78 | |
| SAPLMALVLM Backbone=Cross-LVLM Average2026.05 | 12.22 | 21.32 | 81.63 | 72.94 | |
| Prompt EnsemblesLVLM Backbone=LLaVA-NeXT-Vicuna-13B2026.05 | 12.77 | 23.49 | 77.31 | 68.47 | |
| SAPLMALVLM Backbone=DeepSeek-VL22026.05 | 12.83 | 21.51 | 79.69 | 77.14 | |
| InternalInspectorLVLM Backbone=LLaVA-NeXT-Vicuna-13B2026.05 | 13.79 | 22.31 | 81.42 | 71.87 | |
| CCPSLVLM Backbone=InternVL3.5-14B2026.05 | 14.72 | 23.83 | 71.64 | 58.22 | |
| CCPSLVLM Backbone=Cross-LVLM Average2026.05 | 15.27 | 27.15 | 72.83 | 63.1 | |
| CCPSLVLM Backbone=LLaVA-NeXT-Vicuna-13B2026.05 | 16.27 | 21.98 | 76 | 72.89 | |
| Prompt EnsemblesLVLM Backbone=DeepSeek-VL22026.05 | 16.3 | 24.72 | 72.49 | 73.46 | |
| SAPLMALVLM Backbone=LLaVA-NeXT-Vicuna-13B2026.05 | 16.52 | 22.99 | 82.01 | 72.47 | |
| SAPLMALVLM Backbone=InternVL3.5-14B2026.05 | 16.58 | 23.27 | 76.21 | 65.42 | |
| Prompt EnsemblesLVLM Backbone=InternVL3.5-14B2026.05 | 16.7 | 25.9 | 60.26 | 43.37 | |
| Prompt EnsemblesLVLM Backbone=Cross-LVLM Average2026.05 | 18.46 | 26.07 | 69.28 | 60 | |
| Prompt EnsemblesLVLM Backbone=Qwen3-VL-8B-Instruct2026.05 | 19.8 | 25.96 | 66.2 | 52.9 | |
| Self-ProbingLVLM Backbone=InternVL3.5-14B2026.05 | 21.51 | 24.71 | 76.77 | 70.75 | |
| Self-ProbingLVLM Backbone=Qwen3-VL-8B-Instruct2026.05 | 24.39 | 27.47 | 77 | 59.49 | |
| P(True)LVLM Backbone=LLaVA-NeXT-Vicuna-13B2026.05 | 26.23 | 30.93 | 67.91 | 54.73 | |
| Prompt EnsemblesLVLM Backbone=Gemma-3-27B-IT2026.05 | 26.72 | 30.29 | 70.13 | 61.82 | |
| Self-ProbingLVLM Backbone=Cross-LVLM Average2026.05 | 27.51 | 29.79 | 77.81 | 65.63 | |
| Self-ProbingLVLM Backbone=Gemma-3-27B-IT2026.05 | 27.67 | 29.46 | 79.2 | 68.39 | |
| CCPSLVLM Backbone=Qwen3-VL-8B-Instruct2026.05 | 28.67 | 45.64 | 66.18 | 44.93 | |
| Self-ProbingLVLM Backbone=LLaVA-NeXT-Vicuna-13B2026.05 | 28.92 | 29.97 | 81.87 | 67.3 | |
| P(True)LVLM Backbone=DeepSeek-VL22026.05 | 34.07 | 37.43 | 68.09 | 52.66 | |
| Self-ProbingLVLM Backbone=DeepSeek-VL22026.05 | 35.07 | 37.35 | 74.19 | 62.22 | |
| P(True)LVLM Backbone=Cross-LVLM Average2026.05 | 38.04 | 39.8 | 72.84 | 55.66 | |
| P(True)LVLM Backbone=InternVL3.5-14B2026.05 | 41.19 | 41.45 | 78.02 | 59.49 | |
| P(True)LVLM Backbone=Qwen3-VL-8B-Instruct2026.05 | 43.88 | 44.16 | 76.18 | 54.62 | |
| P(True)LVLM Backbone=Gemma-3-27B-IT2026.05 | 44.8 | 45.05 | 74.01 | 56.81 |