List your company

ResearchFormerly WizWand

MBE

Benchmarks

TaskDatasetSOTA resultTrendResults

Multimodal Retrieval (text query to multimodal candidate)

MBE 2.0

43.34R@1

50

Image-based Retrieval

MBE benchmark

26.76Recall@1

20

Attribute Prediction

MBE 3.0 1.0 (test)

49.92Accuracy

13

Product Classification

MBE 3.0 1.0 (test)

86.4Accuracy

13

Multimodal Retrieval (q^t -> e^i)

MBE 3.0 1.0 (test)

10.24R@1

13

Multimodal Retrieval (q^i -> e^t)

MBE 3.0 1.0 (test)

11.39R@1

13

Multimodal Retrieval (q^mm -> e^mm)

MBE 3.0 1.0 (test)

16.79Recall@1

13

Multimodal Retrieval (q^t -> e^mm)

MBE 3.0 1.0 (test)

12.57Recall@1

13

Multimodal Retrieval (q^i -> e^mm)

MBE 3.0 1.0 (test)

16.14Recall@1

13

Attribute Prediction

MBE 2.0

84.29Accuracy

10

Product Classification

MBE 2.0

68.08Accuracy

10

Product Classification

Our MBE

66.57Accuracy

10

Text-based Retrieval

MBE benchmark

16.92Recall@1

10