Large Vision-Language Model Evaluation on Unweighted Average
9.8ECEII
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| IIBackbone=Qwen/Qwen3-VL-8B-Instruct, Number of Seeds=52026.05 | 9.8 | 20.8 | 65.7 | 71.4 | 73.7 | 70.2 | |
| BICRBackbone=Qwen/Qwen3-VL-8B-Instruct, Number of Seeds=52026.05 | 10.8 | 20.6 | 67.7 | 63.8 | 74.8 | 71.3 | |
| BICRBackbone=OpenGVLab/InternVL3_5-14B-HF, Number of Seeds=52026.05 | 16.2 | 23.3 | 63.3 | 66.5 | 68.7 | 69 | |
| PIKBackbone=Qwen/Qwen3-VL-8B-Instruct, Number of Seeds=52026.05 | 17.9 | 24.2 | 62.6 | 71.7 | 75.3 | 71.7 | |
| BICRBackbone=llava-hf/llava-v1.6-vicuna-13b-hf, Number of Seeds=52026.05 | 19.4 | 22.5 | 64.4 | 55.6 | 59.3 | 69.4 | |
| PIKBackbone=deepseek-ai/deepseek-vl2, Number of Seeds=52026.05 | 19.4 | 23.3 | 59.7 | 47.9 | 49.5 | 61.9 | |
| SAPLMABackbone=Qwen/Qwen3-VL-8B-Instruct, Number of Seeds=52026.05 | 20.6 | 26.2 | 63.1 | 72.5 | 73.8 | 69.6 | |
| IIBackbone=OpenGVLab/InternVL3_5-14B-HF, Number of Seeds=52026.05 | 22.6 | 29.4 | 57.2 | 68.7 | 62.2 | 59.9 | |
| SAPLMABackbone=deepseek-ai/deepseek-vl2, Number of Seeds=52026.05 | 23.7 | 27.2 | 59.8 | 53 | 48.2 | 64.7 | |
| PIKBackbone=OpenGVLab/InternVL3_5-14B-HF, Number of Seeds=52026.05 | 25 | 29.1 | 58.6 | 69.5 | 68.9 | 68.9 | |
| SAPLMABackbone=OpenGVLab/InternVL3_5-14B-HF, Number of Seeds=52026.05 | 26.5 | 30.5 | 60.9 | 70.7 | 63.7 | 64.5 | |
| P(True)Backbone=llava-hf/llava-v1.6-vicuna-13b-hf, Number of Seeds=52026.05 | 26.6 | 25.1 | 58.2 | 33.8 | 50 | 63.2 | |
| PIKBackbone=llava-hf/llava-v1.6-vicuna-13b-hf, Number of Seeds=52026.05 | 26.7 | 27.6 | 56.1 | 56.5 | 58.4 | 68.5 | |
| CCPSBackbone=OpenGVLab/InternVL3_5-14B-HF, Number of Seeds=52026.05 | 30 | 34.2 | 55.3 | 68.3 | 60.9 | 56.9 | |
| IIBackbone=llava-hf/llava-v1.6-vicuna-13b-hf, Number of Seeds=52026.05 | 30.8 | 31.7 | 47.6 | 55.6 | 47 | 55.4 | |
| PEBackbone=deepseek-ai/deepseek-vl2, Number of Seeds=52026.05 | 31.9 | 28.3 | 42.9 | 50.3 | 50.1 | 63.1 | |
| SAPLMABackbone=llava-hf/llava-v1.6-vicuna-13b-hf, Number of Seeds=52026.05 | 32.7 | 32.4 | 51.7 | 57.3 | 54.2 | 64.1 | |
| Self-ProbingBackbone=OpenGVLab/InternVL3_5-14B-HF, Number of Seeds=52026.05 | 33.8 | 33.7 | 56.3 | 67 | 64.1 | 70.7 | |
| CCPSBackbone=llava-hf/llava-v1.6-vicuna-13b-hf, Number of Seeds=52026.05 | 35.3 | 35.5 | 48.9 | 56.7 | 58.8 | 65.7 | |
| PEBackbone=OpenGVLab/InternVL3_5-14B-HF, Number of Seeds=52026.05 | 35.3 | 38 | 52.4 | 65.8 | 56.9 | 54.5 | |
| CCPSBackbone=Qwen/Qwen3-VL-8B-Instruct, Number of Seeds=52026.05 | 35.7 | 48.5 | 50.9 | 51.7 | 64.8 | 49.7 | |
| PEBackbone=llava-hf/llava-v1.6-vicuna-13b-hf, Number of Seeds=52026.05 | 35.7 | 33.4 | 41.7 | 53.9 | 46.4 | 55.8 | |
| PEBackbone=Qwen/Qwen3-VL-8B-Instruct, Number of Seeds=52026.05 | 35.8 | 37.8 | 52.8 | 66.4 | 54.5 | 53 | |
| Self-ProbingBackbone=Qwen/Qwen3-VL-8B-Instruct, Number of Seeds=52026.05 | 36.2 | 38.3 | 58.5 | 67.8 | 65.7 | 59 | |
| P(True)Backbone=OpenGVLab/InternVL3_5-14B-HF, Number of Seeds=52026.05 | 42.4 | 41.9 | 55.9 | 63.9 | 71.5 | 68.9 | |
| P(True)Backbone=deepseek-ai/deepseek-vl2, Number of Seeds=52026.05 | 43 | 39.1 | 40 | 44.2 | 52.4 | 65.2 | |
| Self-ProbingBackbone=llava-hf/llava-v1.6-vicuna-13b-hf, Number of Seeds=52026.05 | 45.7 | 44.6 | 47.3 | 55.1 | 50.2 | 54.4 | |
| P(True)Backbone=Qwen/Qwen3-VL-8B-Instruct, Number of Seeds=52026.05 | 48.4 | 48 | 50.3 | 61.3 | 70.5 | 65.7 | |
| Self-ProbingBackbone=deepseek-ai/deepseek-vl2, Number of Seeds=52026.05 | 50.4 | 49.8 | 39.1 | 49.9 | 51.3 | 52.6 |