MM-MergeBench
Benchmarks
TaskDatasetSOTA resultTrendResults
MM-MergeBench (test)
56.65Accuracy
12
MM-MergeBench Seen Tasks
83.74SciQA Score
12
MM-MergeBench Unseen Tasks
79.3AVQA Score
11
MM-MergeBench seen tasks
69.23Average Absolute Accuracy
9
MM-MergeBench unseen tasks
39.84Average Absolute Accuracy
8
MM-MergeBench 20 tasks 1.0 (test)
91.37Average Absolute Accuracy
6
MM-MergeBench 14 tasks 1.0 (test)
90.88Average Absolute Accuracy
6
MM-MergeBench 8 tasks 1.0 (test)
92.83Avg Absolute Accuracy
6