MultiModalQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MULTIMODALQA (test)
75.5Overall Accuracy
17
MultiModalQA (test)
44.7String Match Accuracy
12
MULTIMODALQA Doc (test)
371Total Time (ms)
10
MultiModalQA (val)
65.1EM
10
MultimodalQA (val)
20.53R@1
7
MultimodalQA (test)
44.57EM
7
MultiModalQA 95 (test)
82.7Accuracy
6
MultimodalQA
69.07R@3
6
MultiModalQA (dev)
85.28F1 Score
5