Visual Document Retrieval on ViDoRe-ESG union scope
55.9NDCG@5ColPali v1.3
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ColPali v1.3Retrieval Strategy=2stage Conv1d, Token Hygiene=true, QPS=1.272026.02 | 55.9 | 57.6 | 57.6 | 66.2 | 81.8 | |
| ColPali v1.3Retrieval Strategy=1stage base, Token Hygiene=true, QPS=0.282026.02 | 55.1 | 57.3 | 57 | 66.1 | 90.8 | |
| ColQwen 2.5Retrieval Strategy=2stage Gauss., Token Hygiene=true, QPS=1.152026.02 | 51.3 | 56 | 54.9 | 69 | 78.8 | |
| ColQwen 2.5Retrieval Strategy=1stage base, Token Hygiene=true, QPS=0.312026.02 | 50.9 | 56.4 | 53.8 | 70.4 | 85.6 | |
| ColSmol 500MRetrieval Strategy=1stage base, Token Hygiene=true, QPS=0.502026.02 | 40.4 | 45.7 | 46 | 62 | 96.1 | |
| ColSmol 500MRetrieval Strategy=3stage casc., Token Hygiene=true, QPS=0.862026.02 | 37.1 | 40.8 | 40.6 | 52 | 67.8 | |
| ColSmol 500MRetrieval Strategy=2stage tiles, Token Hygiene=true, QPS=1.322026.02 | 36.9 | 40.1 | 40.5 | 50.3 | 65.8 |