MMVet
Benchmarks
TaskDatasetSOTA resultTrendResults
MMVet
51.5Score
81
MMVet
83.9Score
63
MMVet
85.67Accuracy
55
MMVet (test)
80.8Accuracy
49
MMVet
46.8Accuracy
38
MMVet
81.3Score
38
MMVet
0.886AUROC
36
MMVet turbo
74Accuracy
28
MMVet v2 (0613)
71.8Accuracy
21
MMVet v1 (val)
33.7Accuracy
19
MMVet
78.1AUC
18
MMVet turbo
69.7Overall Score
16
MMVet (test)
67.1Score
16
MMVet V2
52.6MMVet V2 Score
15
MMVet
67.2MMVet Score
15
MMVet 2024b
66.8Score
13
MMVet
41.5MMVet User Preference Score
10
MMVet
3,296.8Token Length
9
MMVet
74.94Pass@1
9
MMVet pointwise
0.974Kendall's Tau
9
MMVet
58Score
8
MMVet
40.6MMVet Score
7
MMVet turbo
76.2Score
7
MMVet v1.0 (test)
36.87Score
6
MMVet
81.2Score
5