MMLongBench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MMLongBench 256K context
31.63MMLB-D Score
4
MMLongBench MM-NIAH Reason.
51.87Accuracy
2
MMLongBench MM-NIAH Retriev
25.56Accuracy
2
MMLongBench MM-NIAH Count
38.95Soft Accuracy
2
MMLongBench VH-Multi
54.77Accuracy
2
MMLongBench VH-Single
55.85Accuracy
2
MMLongBench ViQuAE
55.68SubEM
2
MMLongBench InfoSeek
60.76SubEM
2
MMLongBench SlideVQA
68.68Document QA Accuracy
2
MMLongBench MMLongDoc
53.29Document QA Accuracy
2
MMLongBench LongDocURL
60.6QA Accuracy
2
MMLongBench iNat
22Accuracy
2
MMLongBench Food
34Accuracy
2
MMLongBench Cars
0.264Accuracy
2