Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

M-BEIR dataset and benchmarks · SOTA2 Research

Research Datasets

M-BEIR

Benchmarks

Task NameDataset NameSOTA MethodSort

Task NameDataset NameSOTA ResultTrendResults

Multi-modal Retrieval

M-BEIR (test)

69.7Average Recall

61

Multi-modal Retrieval

M-BEIR Global Pool 1.0 (test)

48.8VisualNews R@5 (qt->ci)

11

Text-to-Image Retrieval

M-BEIR Flickr30k

79.1R@1

8

Text-to-Image Retrieval

M-BEIR COCO

55.2Recall@1

8

Multi-modal Information Retrieval

M-BEIR local pool setting

49.4q_t_to_c_i VN R@5

8

Multimodal Retrieval

M-BEIR extended (test)

32.1Recall (I→I)

7

Multimodal-to-Text Retrieval

M-BEIR InfoSeek

14.5R@1

4

Multimodal-to-Multimodal Retrieval

M-BEIR OVEN

49.4Recall@1

4

Multimodal-to-Image Retrieval

M-BEIR CIRR

24.4Recall@1

4

Image-to-Image Retrieval

M-BEIR NIGHTS

8.8Recall@1

4

Image-to-Text Retrieval

M-BEIR COCO i→t

71.1R@1

4

Text-to-Multimodal Retrieval

M-BEIR WebQA (t→i,t)

49.5R@1

4

Text-to-Text Retrieval

M-BEIR WebQA (t→t)

58.3Recall@1

4

Popular tasks

Text-to-Image Retrieval Multi-modal Retrieval Image-to-Text Retrieval Multimodal Retrieval Text-to-Text Retrieval

Follow for updates

Join SOTA2 Contact