List your company

ResearchFormerly WizWand

MMQA

Benchmarks

TaskDatasetSOTA resultTrendResults

Multimodal Question Answering

MMQA

70.5Accuracy

36

Multi-modal Retrieval (Image Query)

MMQA

76.52Recall@20

21

Multi-modal Retrieval (Text Query)

MMQA

87.17Recall@20

21

Multimodal Question Answering

MMQA

49.31BLEU-1

20

Multimodal Question Answering

MMQA k=1

57.4ROrig@k

20

Watermark Detection

MMQA

1.03Rank

16

SQL execution performance

MMQA n=1105

50EM (1T)

15

Table Reasoning

MMQA (test)

50Accuracy

13

Multimodal Retrieval-Augmented Generation

MMQA

53.6ROrig.

12

Table Question Answering

MMQA

86.08Accuracy

10

Multi-table Reasoning

MMQA 3-table

40.88Accuracy

9

Table Selection

MMQA 2025 (test)

6.1Avg Tables

8

Question Answering

MMQA QE-PE 5.2 (test)

55.64EM

8

Multi-table Question Answering

MMQA

31.1List EM

7

Membership Inference Attack

MMQA 1,000 images (non-member set)

0.85AUC

4

Question Answering

MMQA QH-PH 5.2 (test)

46.41EM

4

Question Answering

MMQA QE-PH 5.2 (test)

45.12Exact Match (EM)

4

Machine Comprehension

MMQA 5.2 v1.0 (test)

0.744F1 (QE-PE)

4

Multimodal Question Answering

MMQA SemBench 1.0 (test)

23.49Latency (s)

2