VideoMME
Benchmarks
TaskDatasetSOTA resultTrendResults
VideoMME
75Score (Overall)
369
VideoMME
85.1Accuracy
254
VideoMME
100Overall Score
222
VideoMME
89.5Accuracy
97
VideoMME
67.4Accuracy (No Subtitles)
67
VideoMME
84.3Accuracy
64
VideoMME (test)
89.8Short Length Accuracy
61
VideoMME Medium
72.9Accuracy
53
VideoMME wo sub
88.6Accuracy
51
VideoMME
71.9Score
50
VideoMME 16 (test)
70.11Medium Length Score
45
VideoMME (test)
86.9Overall Score
45
VideoMME
75VQA Score (wo subs)
45
VideoMME Overall
73.6Accuracy
40
VideoMME w/o sub
82.5Score
36
VideoMME
71.9Accuracy
33
VideoMME
76Short VQA Accuracy
32
VideoMME
75Score (%)
28
VideoMME v1 (test)
77.2Accuracy
27
VideoMME Long split, 30-60 min
65.3Accuracy
27
VideoMME Long
59Score
25
VideoMME w/o sub. Overall
75Overall Accuracy
22
VideoMME Long (3~120 min)
72.1Score
22
VideoMME w/o sub
77.4Average Accuracy
22
VideoMME
65.6Accuracy (Base)
22