VideoMME
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VideoMME
66.52VideoMME Performance
14
VideoMME v2
56.8Score
13
VideoMME
61.7Overall Score
13
VideoMME Long and Average
63.9Performance (Average)
13
VideoMME
66.9Overall Score
13
VideoMME wo-subs
71.9Accuracy
13
VideoMME Overall
73.5Accuracy
13
VideoMME 2024 (test)
81.7Accuracy (Short, w/o Subtitles)
13
VideoMME
81.3Accuracy (w subs)
13
VideoMME
71.9Accuracy
12
VideoMME
66VideoMME Score (No Subtitles)
12
VideoMME w/ sub
81.3Score
12
VideoMME
64.1Overall Score
11
VideoMME (test)
64.2Accuracy
11
VideoMME w/o subtitles 21 (test)
71.9Average Score
11
VideoMME Long
81.8Accuracy
11
VideoMME long 30–60 min
50.8Accuracy
10
VideoMME
60.8Temporal
9
VideoMME
30.9VYR
9
VideoMME Overall
116.9Prefilling Latency (s)
8
VideoMME Overall 1.0 (test)
68.3Accuracy
8
VideoMME Medium 1.0 (test)
66.6Accuracy
8
VideoMME w/o sub. 1.0 (test)
65Overall Acc
8
VideoMME
58.4VideoMME Overall Score
7
VideoMME long
5.2Runtime (s)
7