MM-Vet
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MM-Vet
82.2MM-Vet Score
664
MM-Vet
86.2MM-Vet Score
551
MM-Vet
85.6Score
429
MM-Vet
64Score
249
MM-Vet
76.9MM-Vet Score
190
MM-VET (test)
67.6Total Score
120
MM-Vet
54.5Average Score
69
MM-Vet v2
81.6Score
46
MM-Vet
72.16Total Score
43
MM-Vet
82.7Score
40
MM-Vet
75.8MM-Vet ASR Accuracy
33
MM-Vet
68.3Total Score
24
MM-Vet v2
71.8MM-Vet v2 Score
23
MM-Vet
75.2Overall Score
23
MM-Vet
74.6Accuracy
20
MM-Vet
46.9Rec
19
MM-Vet
37.4Overall Score
16
MM-Vet v1 (full)
36.2Overall Score (MM-Vet v1)
16
MM-Vet
76.2Pass@1 Accuracy
16
MM-Vet
32.8Accuracy
14
MM-Vet
45.55MM-Vet Score
14
MM-Vet OOD
96.33Accuracy
14
MM-Vet OOD
3.67FPR
14
MM-Vet (test)
70.3Accuracy
13
MM-Vet
193.2Relative Speed (RelSpd)
13