Video-MME
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Video-MME
73.2Accuracy
30
Video-MME no subs standard Long
81.8Accuracy
29
Video-MME w/o sub
80.1Score (Short)
25
Video-MME Long
56.6Video-MME-Long Score
24
Video-MME (w/o sub.) Overall 1010s
75Accuracy
22
Video-MME Sub (test)
87.8Accuracy
22
Video-MME (test)
88.6Accuracy
22
Video-MME 900 videos
85.2Overall Accuracy
22
Video-MME v1.0 (test)
65.3Accuracy (Long)
21
Video-MME Sub (test)
87.8Accuracy
21
Video-MME
67.2Overall Accuracy
20
Video-MME
81.4Video-MME Score
20
Video-MME Long v1.0 (test)
57.89Score
20
Video-MME
71.9Performance (Short)
20
Video-MME Overall 1.0
59Accuracy (No Subtitles)
19
Video-MME
70.9Video-MME Score
18
Video-MME Medium Duration 1.0
58.1Accuracy (No Subtitles)
18
Video-MME Short Duration 1.0
68.1Accuracy (w/o subtitles)
18
Video-MME w.o. sub. Overall
71.1Accuracy
17
Video-MME w.o. sub. Medium
70.8Accuracy
16
Video-MME w.o. sub. Short
80Accuracy
16
Video-MME Long without Subtitles
62.3Overall Accuracy
16
Video-MME
67.41Score
16
Video-MME Long (test)
78.1Overall Score
16
Video-MME
71.56Video MME Score
16