# Multimodal Reranking on MMEB Summary v2 (Overall) Source: [Multimodal Reranking on MMEB Summary v2 (Overall)]() Collection index: [llms.txt]() Data updated: 2026-06-11T08:35:41.619Z Evaluation of model performance on the Multimodal Reranking task using the overall score derived from the MMEB Summary v2 benchmark suite. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Multimodal Reranking | | Dataset (including any stated split) | MMEB Summary v2 (Overall) | | Metric | Overall Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 15 of 15 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Overall Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Overall Score | Result date | Report paper | | --- | --- | --- | --- | | Qwen3-VL-Reranker-8B | 79.2 | Not recorded | 6a28f37890966ade919c19ba | | Qwen3-VL-8B-reranker | 76.5 | Not recorded | 6a28f37890966ade919c19ba | | Qwen3-VL-8B-miniReranker | 75.4 | Not recorded | 6a28f37890966ade919c19ba | | Qwen3-VL-4B-reranker | 75.3 | Not recorded | 6a28f37890966ade919c19ba | | Qwen3-VL-Reranker-2B | 75.2 | Not recorded | 6a28f37890966ade919c19ba | | Qwen3-VL-4B-miniReranker | 74 | Not recorded | 6a28f37890966ade919c19ba | | Qwen3-VL-2B-reranker | 73 | Not recorded | 6a28f37890966ade919c19ba | | Qwen3-VL-2B-miniReranker | 70.3 | Not recorded | 6a28f37890966ade919c19ba | | Qwen3-VL-2B-Instruct | 63.6 | Not recorded | 6a28f37890966ade919c19ba | | GME (7B) | 57.8 | Not recorded | 6a28f37890966ade919c19ba | | GME (2B) | 54.1 | Not recorded | 6a28f37890966ade919c19ba | | VLM2Vec-Qwen2VL (7B) | 52.3 | Not recorded | 6a28f37890966ade919c19ba | | LamRA-Qwen2.5 (7B) | 47.4 | Not recorded | 6a28f37890966ade919c19ba | | VLM2Vec (2B) | 47 | Not recorded | 6a28f37890966ade919c19ba | | ColPali v1.3 (3B) | 44.4 | Not recorded | 6a28f37890966ade919c19ba | ### Qwen3-VL-Reranker-8B Overall Score: 79.2. Result ID: 6a2a7275fbc373592c27900a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Scale":"8B"}. This record does not assert independent reproduction. ### Qwen3-VL-8B-reranker Overall Score: 76.5. Result ID: 6a2a7275fbc373592c27900b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"8B","Fine-tuning Recipe":"our training recipe"}. This record does not assert independent reproduction. ### Qwen3-VL-8B-miniReranker Overall Score: 75.4. Result ID: 6a2a7275fbc373592c27900c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"8B","Fine-tuning Recipe":"our training recipe","Reranker Type":"miniReranker"}. This record does not assert independent reproduction. ### Qwen3-VL-4B-reranker Overall Score: 75.3. Result ID: 6a2a7275fbc373592c279005. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"4B","Fine-tuning Recipe":"our training recipe"}. This record does not assert independent reproduction. ### Qwen3-VL-Reranker-2B Overall Score: 75.2. Result ID: 6a2a7275fbc373592c279001. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Scale":"2B"}. This record does not assert independent reproduction. ### Qwen3-VL-4B-miniReranker Overall Score: 74. Result ID: 6a2a7275fbc373592c279006. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"4B","Fine-tuning Recipe":"our training recipe","Reranker Type":"miniReranker"}. This record does not assert independent reproduction. ### Qwen3-VL-2B-reranker Overall Score: 73. Result ID: 6a2a7275fbc373592c279003. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"2B","Fine-tuning Recipe":"our training recipe"}. This record does not assert independent reproduction. ### Qwen3-VL-2B-miniReranker Overall Score: 70.3. Result ID: 6a2a7275fbc373592c279004. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"2B","Fine-tuning Recipe":"our training recipe","Reranker Type":"miniReranker"}. This record does not assert independent reproduction. ### Qwen3-VL-2B-Instruct Overall Score: 63.6. Result ID: 6a2a7275fbc373592c279002. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"2B"}. This record does not assert independent reproduction. ### GME (7B) Overall Score: 57.8. Result ID: 6a2a7275fbc373592c279007. [Reporting paper]() Recorded evaluation configuration: {"Model Scale":"7B"}. This record does not assert independent reproduction. ### GME (2B) Overall Score: 54.1. Result ID: 6a2a7275fbc373592c278fff. [Reporting paper]() Recorded evaluation configuration: {"Model Scale":"2B"}. This record does not assert independent reproduction. ### VLM2Vec-Qwen2VL (7B) Overall Score: 52.3. Result ID: 6a2a7275fbc373592c279009. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"7B"}. This record does not assert independent reproduction. ### LamRA-Qwen2.5 (7B) Overall Score: 47.4. Result ID: 6a2a7275fbc373592c279008. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Model Scale":"7B"}. This record does not assert independent reproduction. ### VLM2Vec (2B) Overall Score: 47. Result ID: 6a2a7275fbc373592c279000. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"2B"}. This record does not assert independent reproduction. ### ColPali v1.3 (3B) Overall Score: 44.4. Result ID: 6a2a7275fbc373592c278ffe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Scale":"3B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.