Visual Document Retrieval on ViDoRe-Econ union scope
57.2NDCG@5ColQwen 2.5
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ColQwen 2.5Retrieval Strategy=1stage base, Token Hygiene=true, QPS=0.332026.02 | 57.2 | 55.1 | 30.8 | 43.2 | 87.3 | |
| ColQwen 2.5Retrieval Strategy=2stage Gauss., Token Hygiene=true, QPS=1.252026.02 | 57.2 | 55.2 | 30.9 | 43.3 | 82.1 | |
| ColPali v1.3Retrieval Strategy=1stage base, Token Hygiene=true, QPS=0.312026.02 | 48.8 | 49 | 24.4 | 40.1 | 85.5 | |
| ColPali v1.3Retrieval Strategy=2stage Conv1d, Token Hygiene=true, QPS=1.392026.02 | 48.6 | 48.9 | 24.3 | 40.1 | 83.4 | |
| ColSmol 500MRetrieval Strategy=3stage casc., Token Hygiene=true, QPS=0.882026.02 | 33.2 | 33 | 17.3 | 26.6 | 68.8 | |
| ColSmol 500MRetrieval Strategy=2stage tiles, Token Hygiene=true, QPS=1.542026.02 | 32.9 | 32.5 | 17.1 | 26.1 | 63.6 | |
| ColSmol 500MRetrieval Strategy=1stage base, Token Hygiene=true, QPS=0.522026.02 | 32.3 | 32.7 | 16.5 | 26.8 | 69.2 |