Video-MME
Benchmarks
TaskDatasetSOTA resultTrendResults
Video-MME without subtitles
84.8Overall Score
145
Video-MME
87.8Accuracy
139
Video-MME Long
81.9Accuracy
120
Video-MME
78.18Overall Score
96
Video-MME
78.78Overall Score
92
Video-MME
84.8Accuracy
90
Video-MME
88.6Overall Score
90
Video-MME Overall
87Accuracy
81
Video-MME without subtitles
75.4Accuracy (Overall)
81
Video-MME
68.4Accuracy
73
Video-MME Long
82Accuracy
71
Video-MME
75Accuracy
57
Video-MME v1.0 (test)
72.4Score (Short)
56
Video-MME (full)
66.4Overall Performance
51
Video-MME (test)
88.6Accuracy
51
Video-MME
76.3Score (Overall)
49
Video-MME
82.8Accuracy (Average, wo/ Subtitle)
48
Video-MME w/o sub.
76.6Accuracy
46
Video-MME long 1.0
67.4Accuracy (No Subs)
45
Video MME
61.9Score
43
Video-MME
84.3Average Score
41
Video-MME Long Duration 1.0
67.4Accuracy (w/o subtitles)
34
Video-MME
86.9Accuracy
32
Video-MME Long
67.4Accuracy (Long, wo Sub)
32
Video MME w/o sub (long)
71.4Accuracy
30