Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Multimodal Question Answering research benchmarks – Page 2 · SOTA2 Research

Multimodal Question Answering

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

MMBench EN V1.1

67.53Accuracy

18

Jun 2, 2026

71.56Accuracy

18

Jun 2, 2026

MULTIMODALQA (test)

UniMMQA (T5 3B)

75.5Overall Accuracy

17

Apr 23, 2026

WebQA Text-grounded n=2,455 (test)

48.6F1 Score

16

Jun 11, 2026

WebQA Image-grounded n=2,511 (test)

69.4F1 Score

16

Jun 11, 2026

54.9F1 Score

16

Jun 11, 2026

13.8F1 Score

16

Jun 11, 2026

9 Multimodal Benchmarks (VQAv2, GQA, VizWiz, SQA-IMG, TextVQA, POPE, MME, MMB, MMB-CN) (test val)

80VQAv2 Accuracy

15

Mar 4, 2026

65.94CP

15

Feb 26, 2026

Environmental Report

80.8Comprehensiveness

14

Apr 21, 2026

92Comprehensiveness

14

Apr 21, 2026

MM-Lifelong @day (test)

99.2Accuracy

14

Mar 6, 2026

MM-Lifelong week (test)

95.6Accuracy

14

Mar 6, 2026

MM-Lifelong (val@month)

80.4Accuracy

14

Mar 6, 2026

83.6MMBench Score

13

May 13, 2026

70.3Accuracy

13

May 6, 2026

MMBench-CN (dev)

73Accuracy

13

Apr 21, 2026

77.3Accuracy

13

Apr 21, 2026

GPT-5-MCERF-Hybrid

95Retrieval F1 (BoW)

13

Apr 14, 2026

AudioTSLM (1.4B)

93.5Yes/No Accuracy

13

Mar 17, 2026

MULTIMODALQADoc

65.15EM

12

Feb 26, 2026

ScienceQA-IMG zero-shot

70.4Accuracy

12

Feb 26, 2026

CRIT Scientific Paper 1.0 (test)

Qwen2.5-VL_CRIT

15.9EM

11

Apr 3, 2026

CRIT (Video Frame) 1.0 (test)

Qwen2.5-VL_CRIT

38.8Exact Match (EM)

11

Apr 3, 2026

CRIT Natural Image 1.0 (test)

Qwen2.5-VL_CRIT

58.6EM

11

Apr 3, 2026

Page 2 of 3

Popular datasets

MMBench WebQA ScienceQA MMQA MultiModalQA

Follow for updates

Join SOTA2 Contact