Visual Document Retrieval on VisRAG
87.2nDCG@10 (Arxiv)GME-7B
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| GME-7BOptimization=Base2026.03 | 87.2 | — | 82.32 | 92.92 | 88.89 | 63.36 | 94.81 | 84.92 | |
| ColParseBackbone=GME-7B2026.03 | 87.12 | — | 83.94 | 92.84 | 89.62 | 62.53 | 94.97 | 85.17 | |
| ColParseBackbone=GME-2B2026.03 | 81.65 | — | 83.87 | 91.06 | 85.89 | 63.17 | 93.76 | 83.23 | |
| GME-2BOptimization=Base2026.03 | 81.37 | — | 81.7 | 91.31 | 85.03 | 63.81 | 93.6 | 82.8 | |
| VLM2Vec-V2-2BOptimization=Base2026.03 | 77.38 | — | 82.3 | 86.27 | 71.6 | 66.96 | 92.04 | 79.43 | |
| ColParseBackbone=VLM2Vec-V2-2B2026.03 | 77.18 | — | 78.05 | 84.37 | 78.07 | 58.74 | 91.95 | 78.06 | |
| UniME-V2-2BOptimization=Base2026.03 | 61.19 | — | 65.48 | 76.76 | 59.65 | 45.25 | 77.5 | 64.31 | |
| ColParseBackbone=VLM2Vec-V1-7B2026.03 | 54.43 | — | 70.3 | 69.27 | 58.49 | 33.46 | 77.98 | 60.66 | |
| VLM2Vec-V1-7BOptimization=Base2026.03 | 52.58 | — | 69.83 | 71.43 | 52.86 | 34.24 | 73.22 | 59.03 | |
| VLM2Vec-V1-2BOptimization=Base2026.03 | 41.68 | — | 58.21 | 70.79 | 42.74 | 23.83 | 74.07 | 51.89 | |
| ColParseBackbone=VLM2Vec-V1-2B2026.03 | 38.18 | — | 60.09 | 69.44 | 48.29 | 18.83 | 76.95 | 51.96 | |
| LamRA-RetOptimization=Base2026.03 | 11.17 | — | 63.5 | 59.78 | 33.57 | 29.42 | 57.59 | 42.51 | |
| ColParseBackbone=LamRA-Ret2026.03 | 5.91 | — | 60.76 | 54.91 | 38.77 | 25.27 | 62.34 | 41.33 | |
| colnomic-embed-multimodal-3bSize=3B2026.01 | — | 86.8 | — | — | — | — | — | — | |
| colnomic-embed-multimodal-7bSize=7B2026.01 | — | 88.7 | — | — | — | — | — | — | |
| colqwen2.5-v0.2Size=3B2026.01 | — | 86.6 | — | — | — | — | — | — | |
| llama-nemoretriever-colembed-1b-v1Size=1B2026.01 | — | 82.4 | — | — | — | — | — | — | |
| llama-nemoretriever-colembed-3b-v1Size=3B2026.01 | — | 85.5 | — | — | — | — | — | — | |
| Qwen3-VL-Embedding-2BSize=2B2026.01 | — | 86.4 | — | — | — | — | — | — | |
| Qwen3-VL-Embedding-8BSize=8B2026.01 | — | 88.7 | — | — | — | — | — | — | |
| Qwen3-VL-Ranker-2BSize=2B2026.01 | — | 90.2 | — | — | — | — | — | — | |
| Qwen3-VL-Ranker-8BSize=8B2026.01 | — | 91.2 | — | — | — | — | — | — | |
| tomoro-colqwen3-embed-4bSize=4B2026.01 | — | 89 | — | — | — | — | — | — | |
| tomoro-colqwen3-embed-8bSize=8B2026.01 | — | 90.2 | — | — | — | — | — | — |