Multimodal Information Embedding on MIEB lite
2Mean RankBidirLM-Omni-2.5B
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| BidirLM-Omni-2.5BParams=2.5B, Zero Shot=100%2026.04 | 2 | 28.8 | 46 | 76.9 | 73.6 | 61.1 | 48.6 | 48.1 | 54.7 | 58.1 | |
| E5-VParams=8.4B, Zero Shot=100%2026.04 | 6 | 26.9 | 39.4 | 56 | 70.6 | 51.7 | 52.6 | 36.2 | 47.6 | 51.9 | |
| Nemotron-Omni-3BParams=4.7B2026.04 | 8 | 31.8 | 41 | 46.6 | 68.3 | 75.6 | 47.9 | 43.7 | 50.7 | 51.4 | |
| CLIP-bigGParams=2.5B, Zero Shot=100%2026.04 | 9 | 34.2 | 35 | 35.5 | 77.8 | 80.8 | 43 | 72.4 | 54.1 | 51.3 | |
| EVA02-bigE+Params=5.0B, Zero Shot=100%2026.04 | 11 | 35.2 | 38.9 | 26.2 | 80 | 87.3 | 38.8 | 74 | 54.4 | 50.8 | |
| CLIP-L-DCParams=428M, Zero Shot=100%2026.04 | 13 | 31 | 31.6 | 30.8 | 75.3 | 80.4 | 54.9 | 69.4 | 53.4 | 50.4 | |
| CLIP-HParams=986M, Zero Shot=100%2026.04 | 14 | 32.8 | 34.8 | 33.7 | 76.8 | 79.3 | 46.8 | 69.4 | 53.4 | 50 | |
| CLIP-B16-DCParams=150M, Zero Shot=100%2026.04 | 22 | 28.3 | 31.4 | 22.7 | 73.2 | 73.6 | 56.9 | 61.9 | 49.7 | 46.6 | |
| VLM2VecParams=4.1B, Zero Shot=100%2026.04 | 24 | 20.9 | 30.2 | 42.8 | 64.8 | 65.4 | 65.3 | 32.1 | 45.9 | 46 |