VideoMME
Benchmarks
TaskDatasetSOTA resultTrendResults
VideoMME
66.52VideoMME Performance
14
VideoMME v2
56.8Score
13
VideoMME
61.7Overall Score
13
VideoMME Long and Average
63.9Performance (Average)
13
VideoMME
66.9Overall Score
13
VideoMME wo-subs
71.9Accuracy
13
VideoMME Overall
73.5Accuracy
13
VideoMME 2024 (test)
81.7Accuracy (Short, w/o Subtitles)
13
VideoMME
81.3Accuracy (w subs)
13
VideoMME
71.9Accuracy
12
VideoMME
66VideoMME Score (No Subtitles)
12
VideoMME w/ sub
81.3Score
12
VideoMME
64.1Overall Score
11
VideoMME (test)
64.2Accuracy
11
VideoMME w/o subtitles 21 (test)
71.9Average Score
11
VideoMME Long
81.8Accuracy
11
VideoMME long 30–60 min
50.8Accuracy
10
VideoMME
60.8Temporal
9
VideoMME
30.9VYR
9
VideoMME Overall
116.9Prefilling Latency (s)
8
VideoMME Overall 1.0 (test)
68.3Accuracy
8
VideoMME Medium 1.0 (test)
66.6Accuracy
8
VideoMME w/o sub. 1.0 (test)
65Overall Acc
8
VideoMME
58.4VideoMME Overall Score
7
VideoMME long
5.2Runtime (s)
7