Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MMQA dataset and benchmarks · SOTA2 Research

Research Datasets

MMQA

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Multimodal Question Answering

MMQA

70.5Accuracy

36

Multi-modal Retrieval (Image Query)

MMQA

76.52Recall@20

21

Multi-modal Retrieval (Text Query)

MMQA

87.17Recall@20

21

Multimodal Question Answering

MMQA

49.31BLEU-1

20

Multimodal Question Answering

MMQA k=1

57.4ROrig@k

20

Watermark Detection

MMQA

1.03Rank

16

SQL execution performance

MMQA n=1105

50EM (1T)

15

Table Reasoning

MMQA (test)

50Accuracy

13

Multimodal Retrieval-Augmented Generation

MMQA

53.6ROrig.

12

Table Question Answering

MMQA

86.08Accuracy

10

Multi-table Reasoning

MMQA 3-table

40.88Accuracy

9

Table Selection

MMQA 2025 (test)

6.1Avg Tables

8

Question Answering

MMQA QE-PE 5.2 (test)

55.64EM

8

Multi-table Question Answering

MMQA

31.1List EM

7

Membership Inference Attack

MMQA 1,000 images (non-member set)

0.85AUC

4

Question Answering

MMQA QH-PH 5.2 (test)

46.41EM

4

Question Answering

MMQA QE-PH 5.2 (test)

45.12Exact Match (EM)

4

Machine Comprehension

MMQA 5.2 v1.0 (test)

0.744F1 (QE-PE)

4

Multimodal Question Answering

MMQA SemBench 1.0 (test)

23.49Latency (s)

2

Popular tasks

Multimodal Question Answering Question Answering Table Question Answering Watermark Detection Machine Comprehension

Follow for updates

Join SOTA2 Contact