List your company

ResearchFormerly WizWand

MultiModalQA

Benchmarks

TaskDatasetSOTA resultTrendResults

Multimodal Question Answering

MULTIMODALQA (test)

75.5Overall Accuracy

17

Multi-modal Question Answering

MultiModalQA (test)

44.7String Match Accuracy

12

Multimodal Retrieval

MULTIMODALQA Doc (test)

371Total Time (ms)

10

Multimodal Question Answering

MultiModalQA (val)

65.1EM

10

Multimodal Information Retrieval

MultimodalQA (val)

20.53R@1

7

End-to-end Question Answering

MultimodalQA (test)

44.57EM

7

Multimodal Question Answering

MultiModalQA 95 (test)

82.7Accuracy

6

MultimodalQA

69.07R@3

6

Multi-modal Question Answering

MultiModalQA (dev)

85.28F1 Score

5