Video-MME
Benchmarks
TaskDatasetSOTA resultTrendResults
Video-MME (test)
60.2Overall Accuracy
15
Video-MME
73.4Score
15
Video-MME w/o subtitles
0.818Accuracy
14
Video-MME With Subtitles
75.8Performance (Short)
14
Video-MME
0Average Sparsity
14
Video-MME w/o sub.
72.3Score (w/o sub)
13
Video-MME
81.8VQA Accuracy (Overall)
13
Video-MME long overall durations
66.46Acc (Long, -subs)
13
Video-MME w/o audio
64.4Accuracy
13
Video-MME w/o sub (full)
81.2Score (Long)
13
Video-MME v2 2026
49.7Accuracy
12
Video-MME 2025
79.4Accuracy
12
Video-MME Long
63.4Accuracy
12
Video-MME
81.8TP Accuracy
12
Video-MME
65.3Accuracy (All)
12
Video-MME long-form duration
66.1Overall Performance
12
Video-MME (val)
75Accuracy
12
Video-MME
67.7P@1
11
Video-MME
75Performance Score
10
Video-MME truncated <= 5min v2
15.33Overall Score
10
Video-MME short
83.56Overall Score
10
Video-MME L
57.7Accuracy
10
Video-MME w/ audio
68.4Accuracy
10
Video-MME
75VQA Score (All)
10
Video-MME w/ Subtitles
61.33Score
9