MMLongBench
Benchmarks
TaskDatasetSOTA resultTrendResults
MMLongBench-Doc
65.8Overall Accuracy
77
MMLongBench-Doc
55.8Accuracy
58
MMLongbench doc
45.6Accuracy
48
MMLongBench
53.82Doc Retrieval Rate
46
MMLongBench-Doc
65.8Accuracy
40
MMLongBench
48.2Accuracy
26
MMLongBench Overall
90.77Average Score
22
MMLongBench 128K context
83.33MMLB-D
22
MMLongBench 64K context
93.1MMLB-D
22
MMLongBench
75.86Recall
18
MMLongBench
27.49Text Accuracy
17
MMLongBench-Doc (test)
49.09Accuracy
16
MMLongBench Doc
57.5Score
14
MMLongBench-Doc
75.68Recall
12
MMLongBench Doc
42.3Accuracy
12
MMLongBench (test)
34.7Chart Acc.
12
MMLongBench 32K
82.4Accuracy
11
MMLongBench 128K
78.6Accuracy
11
MMLongBench
43.8Exact Match
11
MMLongBench Finreport
49.62MRR@10
6
MMLongBench Doc
47.64MRR@10
6
MMLongBench-Doc
61.4Pass@1
5
MMLongBench
74.8Pass@1
5
MMLongBench-Doc
94.9Accuracy
5
MMLongBench 512K context
31.91MMLongBench-D Score
4