Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Mantis dataset and benchmarks · SOTA2 Research

Research Datasets

Mantis

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Multi-image reasoning

Mantis (test)

72.81Accuracy

39

Multi-image Reasoning

Mantis

81.71Accuracy

38

Adversarial Attack

Mantis Eval

84.57Attack Success Rate

37

Interleaved Image Multimodal Understanding

Mantis

64.2Score

17

Visual Question Answering

Mantis Eval

71.32ASR

12

Multimodal Reasoning

Mantis-Eval

59.23Accuracy

11

Visual Question Answering

Mantis

81.57Accuracy

6

Multi-Image Understanding

Mantis (Eval)

79.7Score

5

Multi-image Visual Question Answering

Mantis

76.5Accuracy

4

Multi-image in the Wild

Mantis

77.6Accuracy

4

Intent Prediction

MANTIS

77.1AP

4

Multi-image Understanding

Mantis-Eval (test)

66.36Accuracy

2

Multi-image Multi-modal Understanding

Mantis

65.4Accuracy

2

Popular tasks

Visual Question Answering Multi-image Understanding Multi-image Reasoning Multimodal Reasoning Adversarial Attack

Follow for updates

Join SOTA2 Contact