Multimodal Reranking on MMEB Summary v2 (Overall)
79.2Overall ScoreQwen3-VL-Reranker-8B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen3-VL-Reranker-8BModel Scale=8B2026.06 | 79.2 | |
| Qwen3-VL-8B-rerankerModel Scale=8B, Fine-tuning Recipe=our training recipe2026.06 | 76.5 | |
| Qwen3-VL-8B-miniRerankerModel Scale=8B, Fine-tuning Recipe=our training recipe, Reranker Type=miniReranker2026.06 | 75.4 | |
| Qwen3-VL-4B-rerankerModel Scale=4B, Fine-tuning Recipe=our training recipe2026.06 | 75.3 | |
| Qwen3-VL-Reranker-2BModel Scale=2B2026.06 | 75.2 | |
| Qwen3-VL-4B-miniRerankerModel Scale=4B, Fine-tuning Recipe=our training recipe, Reranker Type=miniReranker2026.06 | 74 | |
| Qwen3-VL-2B-rerankerModel Scale=2B, Fine-tuning Recipe=our training recipe2026.06 | 73 | |
| Qwen3-VL-2B-miniRerankerModel Scale=2B, Fine-tuning Recipe=our training recipe, Reranker Type=miniReranker2026.06 | 70.3 | |
| Qwen3-VL-2B-InstructModel Scale=2B2026.06 | 63.6 | |
| GME (7B)Model Scale=7B2026.06 | 57.8 | |
| GME (2B)Model Scale=2B2026.06 | 54.1 | |
| VLM2Vec-Qwen2VL (7B)Model Scale=7B2026.06 | 52.3 | |
| LamRA-Qwen2.5 (7B)Model Scale=7B2026.06 | 47.4 | |
| VLM2Vec (2B)Model Scale=2B2026.06 | 47 | |
| ColPali v1.3 (3B)Model Scale=3B2026.06 | 44.4 |