Visual Document Retrieval on ViDoRe In-Domain V1 (test)
88Arxiv Domain PerformanceColQwen2
Evaluation Results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ColQwen2Size=2B, Backbone=Other LLM2026.03 | 88 | 61.5 | 92.5 | 89 | 82.2 | 89.9 | 99 | 95.9 | 95.5 | 98.8 | 89.2 | |
| Omni-EmbedSize=3B, Backbone=Other LLM2026.03 | 85.3 | 59.2 | 89.2 | 91 | 69.7 | 78.6 | 98.1 | 93.5 | 95.4 | 95.8 | 85.7 | |
| MUREFullSize=3B, Backbone=PaliGemma-3B2026.03 | 84.6 | 61.7 | 89 | 89.3 | 76.8 | 83.2 | 98.7 | 95.2 | 94.4 | 97.1 | 87 | |
| MURE1536Size=3B, Backbone=PaliGemma-3B2026.03 | 84.4 | 61.5 | 88.9 | 89.6 | 75.3 | 81.1 | 98.3 | 94 | 93.1 | 97.2 | 86.4 | |
| MURE512Size=3B, Backbone=PaliGemma-3B2026.03 | 84.3 | 61.7 | 87.9 | 90.6 | 73.2 | 78.9 | 97.2 | 93.2 | 93.1 | 96.4 | 85.7 | |
| MURE1024Size=3B, Backbone=PaliGemma-3B2026.03 | 84.2 | 62.8 | 88 | 90 | 74.9 | 81.5 | 97.6 | 94.6 | 94.1 | 96.3 | 86.4 | |
| ColMate-PaliSize=3B, Backbone=PaliGemma-3B2026.03 | 83.6 | 57.5 | 84.1 | 87.6 | 74 | 79.8 | 98.3 | 94.1 | 95.3 | 96.6 | 85.1 | |
| ColPaliSize=3B, Backbone=PaliGemma-3B2026.03 | 83 | 58.4 | 85.7 | 87.4 | 70.3 | 77.3 | 97.4 | 95.4 | 96.2 | 96.9 | 84.9 | |
| ColPali(Reproduced)Size=3B, Backbone=PaliGemma-3B2026.03 | 82.2 | 59.6 | 84.2 | 88.9 | 68.1 | 77.8 | 95.7 | 94.6 | 94.8 | 95.1 | 84.1 | |
| DSESize=4B, Backbone=Other LLM2026.03 | 78.1 | 45.8 | 82 | 79.2 | 49 | 69.8 | 96.8 | 92.6 | 92 | 96.3 | 78.2 | |
| One-PeaceSize=4B, Backbone=Other LLM2026.03 | 43.9 | 23.4 | 59.9 | 57 | 13.4 | 17 | 45.4 | 53.2 | 55.9 | 59.5 | 42.9 | |
| E5-VSize=8B, Backbone=Other LLM2026.03 | 41.1 | 24.3 | 49.5 | 58.2 | 9 | 13.2 | 46.1 | 57.7 | 53 | 59.6 | 41.2 |