Visual Document Retrieval on ViDoRe-Bio union scope
0.575NDCG@5ColQwen 2.5
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| ColQwen 2.5Retrieval Strategy=1stage base, Token Hygiene=true, QPS=0.322026.02 | 0.575 | 0.612 | 0.605 | 0.718 | 0.88 | |
| ColQwen 2.5Retrieval Strategy=2stage Gauss., Token Hygiene=true, QPS=1.282026.02 | 0.574 | 0.611 | 0.605 | 0.716 | 0.865 | |
| ColPali v1.3Retrieval Strategy=1stage base, Token Hygiene=true, QPS=0.272026.02 | 0.566 | 0.601 | 0.611 | 0.713 | 0.911 | |
| ColPali v1.3Retrieval Strategy=2stage Conv1d, Token Hygiene=true, QPS=1.372026.02 | 0.566 | 0.601 | 0.61 | 0.712 | 0.902 | |
| ColSmol 500MRetrieval Strategy=1stage base, Token Hygiene=true, QPS=0.502026.02 | 0.39 | 0.42 | 0.431 | 0.519 | 0.778 | |
| ColSmol 500MRetrieval Strategy=2stage tiles, Token Hygiene=true, QPS=1.502026.02 | 0.381 | 0.406 | 0.413 | 0.49 | 0.677 | |
| ColSmol 500MRetrieval Strategy=3stage casc., Token Hygiene=true, QPS=0.882026.02 | 0.371 | 0.397 | 0.399 | 0.477 | 0.655 |