List your company

ResearchFormerly WizWand

M-BEIR

Benchmarks

TaskDatasetSOTA resultTrendResults

Multi-modal Retrieval

M-BEIR (test)

69.7Average Recall

61

Multi-modal Retrieval

M-BEIR Global Pool 1.0 (test)

48.8VisualNews R@5 (qt->ci)

11

Text-to-Image Retrieval

M-BEIR Flickr30k

79.1R@1

8

Text-to-Image Retrieval

M-BEIR COCO

55.2Recall@1

8

Multi-modal Information Retrieval

M-BEIR local pool setting

49.4q_t_to_c_i VN R@5

8

Multimodal Retrieval

M-BEIR extended (test)

32.1Recall (I→I)

7

Multimodal-to-Text Retrieval

M-BEIR InfoSeek

14.5R@1

4

Multimodal-to-Multimodal Retrieval

M-BEIR OVEN

49.4Recall@1

4

Multimodal-to-Image Retrieval

M-BEIR CIRR

24.4Recall@1

4

Image-to-Image Retrieval

M-BEIR NIGHTS

8.8Recall@1

4

Image-to-Text Retrieval

M-BEIR COCO i→t

71.1R@1

4

Text-to-Multimodal Retrieval

M-BEIR WebQA (t→i,t)

49.5R@1

4

Text-to-Text Retrieval

M-BEIR WebQA (t→t)

58.3Recall@1

4