Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

MuirBench dataset and benchmarks · SOTA2 Research

Research Datasets

MuirBench

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Multi-image Reasoning

MuirBench

77.2Accuracy

112

Multi-image Understanding

MuirBench

74.5Score

41

Multi-image reasoning

Muirbench (test)

68Accuracy

24

Multi-Image Understanding

MuirBench (test)

68Accuracy

21

Multimodal Reasoning

MuirBench

57.14Accuracy

21

Visual Question Answering

MuirBench

78.6Accuracy

19

Multi-modal Reasoning

MUIRBENCH

92.94Difference Reasoning Accuracy

19

Multi-Image Understanding

MuirBench 142 (test)

86.1Score

19

Multi-image Understanding

MuirBench Multi-image Understanding

62.3Accuracy

17

Multi-modal Understanding

MuirBench

59.6Score

16

Multi-image hallucination evaluation

MUIRBench

62Accuracy

12

Vision-Centric Reasoning

MuirBench

68Accuracy

11

Vision-Centric Understanding

MuirBench

68Accuracy

10

Multi-image and Video Understanding

MuirBench

41.4Accuracy

9

General Reasoning

MuirBench

59.2Accuracy

8

MUIRBench

81.8Pass@1

7

Procedural Temporal Understanding

MuirBench (test)

65.04Overall Score

7

General Visual Question Answering

MuirBench

70.7Score

5

Multimodal Perception

MuirBench

45.42Score (%)

4

Video Understanding

MuirBench

48.12Score

4

Multi-image Visual Question Answering

MUIRBench

76.4Accuracy

4

Comprehensive Multi-image

MuirBench

62.3Accuracy

4

Multimodal Understanding

MuirBench

73Accuracy

3

Multi-image Multi-modal Understanding

MuirBench

41.8Accuracy

2

Popular tasks

Multi-image Understanding Multi-image Reasoning Visual Question Answering Multimodal Reasoning Video Understanding

Follow for updates

Join SOTA2 Contact