MMEB
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MMEB Video V2
51.6CLS Accuracy
15
MMEB V2
80.15Image Recall@1
10
MMEB Video Retrieval (MSRVTT, MSVD, DiDeMo, YouCook2, VATEX) v2
39.3Retrieval Score
10
MMEB Kinetics-700, SSv2, HMDB, UCF, Breakfast v2
63.2Classification Accuracy
10
MMEB Image v2
68.1Accuracy (CLS)
9
MMEB (val)
66.8Image Classification Accuracy
9
MMEB Video portion v2
56.8K700 Score
9
MMEB Video Retrieval (MSRVTT, MSVD, DiDeMo, YouCook2, VATEX) v2 (test)
43.1Retrieval Score
8
MMEB Video Classification (Kinetics-700, SSv2, HMDB, UCF, Breakfast) v2 (test)
63.7Classification Accuracy
8
MMEB Total v2
61.6Total Score
7
MMEB Video QA v2 (test)
72.5Average Score
6
MMEB-Video v1 (test)
67.15Overall Score
3
MMEB Video zero-shot
63Overall Accuracy
2