VideoMME
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
VideoMME Overall (w/o sub.) 2025
75Accuracy
21
VideoMME no subtitles (test)
71.9Accuracy
21
VideoMME v1.0 (test)
60.8Score
21
VideoMME w/ sub
87.8Score
21
VideoMME
3.27Wall-time Speedup
21
VideoMME
75Accuracy (no subs)
21
VideoMME KFS-Bench full set
68.4Accuracy
20
VideoMME
76.7Accuracy (Short Length)
19
VideoMME 1~60m, w/o subtitles
75Score
18
VideoMME (long split)
67.4Accuracy
18
VideoMME
61.48Score
17
VideoMME w/o sub. Long
67.4Long Accuracy
16
VideoMME w/o sub
61.1Accuracy
16
VideoMME
73Score
16
VideoMME
77.4Accuracy (Overall, w/o Subtitles)
16
VideoMME Long w/o sub
70.3Accuracy
16
VideoMME w/o sub.
65.3Accuracy (Overall)
16
VideoMME long
69Accuracy
15
VideoMME (average)
81.3Accuracy
15
VideoMME w/ subtitle
81.3Accuracy
15
VideoMME w/ sub
81.3Accuracy
15
VideoMME w/o sub
87Accuracy
15
VideoMME with subtitles
64.8Acc (Overall)
15
VideoMME
75Accuracy
15
VideoMME Long
69.7Accuracy (Long)
14