MMVP
Benchmarks
TaskDatasetSOTA resultTrendResults
MMVP
76.67Accuracy
118
MMVP
86.33Accuracy
106
MMVP
80.33Accuracy
82
MMVP
86.3Accuracy
67
MMVP
86.33Accuracy
45
MMVP
74.9Accuracy
41
MMVP
80.9Accuracy
30
MMVP
85.33Accuracy
29
MMVP VLM
26.7Orientation and Direction Accuracy
27
MMVP
76Accuracy
26
MMVP-VLM (test)
0.763MMVP Average Acc
26
MMVP
80.33Accuracy
25
MMVP
75.3MMVP Score
23
MMVP
86.3Accuracy
21
MMVP
57.6Accuracy
16
MMVP
77Accuracy
15
MMVP (test)
40.3MMVP Score
13
MMVP
72.1Accuracy
13
MMVP
72.1Score
12
MMVP
0.805Sentence Faithfulness (Insertion)
12
MMVP
65.2Score
12
MMVP (test)
75.33MMVP Score
11
MMVP (test)
68.7Accuracy
11
MMVP-VLM
60Orientation Score
11
MMVP
75.3Accuracy
10