Visual Document Retrieval on ViDoRe V1+V2 (test)
93.8ArXiv NDCG@5Sauerkraut-8b
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Sauerkraut-8b2026.06 | 93.8 | 64.7 | 94.5 | 90.4 | 98.6 | 96.5 | 96.8 | 99.3 | 92.2 | 84 | 64.9 | 58.4 | 70.8 | 57.6 | 91.1 | 62.9 | 83 | |
| Nemotron-colembed-8b-v22026.06 | 93.1 | 68.1 | 94.6 | 93.3 | 100 | 97.9 | 98.9 | 99.6 | 97.7 | 83.4 | 67 | 59 | 73.2 | 60.4 | 92.7 | 64.9 | 84.7 | |
| Argus-9BBackbone=Qwen3.5-VL-9B-Instruct2026.06 | 92.3 | 68.1 | 94.3 | 93.6 | 99.6 | 97.3 | 98.9 | 99.6 | 97.5 | 85.5 | 66.2 | 67.6 | 79.1 | 63.8 | 92.7 | 69.2 | 86 | |
| Nemotron-colembed-4b-v22026.06 | 92 | 67.4 | 93.3 | 92.3 | 99.3 | 96.2 | 98 | 98.5 | 98.1 | 81.2 | 64 | 62.4 | 71.4 | 57.7 | 91.6 | 63.9 | 83.7 | |
| Sauerkraut-4b2026.06 | 91.8 | 67 | 94.2 | 90.5 | 99.6 | 96.5 | 96.2 | 100 | 89.5 | 82.7 | 60 | 58.8 | 69.2 | 56 | 90.8 | 61 | 82.3 | |
| Ops-Colqwen3-4B2026.06 | 91.8 | 66.5 | 94 | 90.8 | 99.6 | 97.3 | 98 | 99.6 | 93.6 | 82.4 | 64.9 | 65.6 | 78.6 | 61.9 | 91.4 | 67.8 | 84.6 | |
| Argus-4BBackbone=Qwen3.5-VL-4B-Instruct2026.06 | 91 | 67.7 | 94.6 | 94.7 | 99.6 | 97.9 | 97.8 | 99.6 | 95.3 | 84.8 | 64.4 | 62.2 | 69.9 | 59.8 | 92.3 | 64.1 | 84.2 | |
| Argus-2BBackbone=Qwen3.5-VL-2B-Instruct2026.06 | 90.3 | 67.5 | 95 | 91.3 | 99.6 | 97.3 | 97.3 | 99.3 | 93.4 | 84 | 65 | 59.9 | 69.4 | 51.9 | 91.5 | 61.5 | 82.9 | |
| ColQwen2.52026.06 | 88.9 | 63.6 | 92.5 | 87.9 | 99.6 | 96.1 | 95.8 | 98 | 90.8 | 82.1 | 59.2 | 58.3 | 66.4 | 53.3 | 89.5 | 59.3 | 80.9 | |
| Nemotron-colembed-3b-v12026.06 | 88.4 | 66.2 | 94.9 | 90.7 | 99.6 | 96.6 | 97.8 | 99.3 | 95.9 | 80.6 | 64.3 | 58.6 | 75.4 | 55.9 | 91 | 63.5 | 83.2 | |
| ColNomic-7b2026.06 | 88.3 | 60.1 | 92.2 | 89.3 | 98.8 | 96.3 | 95.9 | 99.3 | 96 | 81.1 | 63.4 | 54.8 | 68.7 | 56.2 | 89.7 | 60.8 | 81.5 | |
| ColNomic-3b2026.06 | 88.1 | 61.3 | 92.8 | 90.1 | 96.3 | 97.4 | 96.6 | 98.3 | 94.4 | 83.2 | 62.5 | 49.2 | 57 | 53.3 | 89.9 | 55.5 | 80 | |
| ColQwen2 v1.02026.06 | 88 | 61.5 | 92.5 | 89.9 | 99 | 95.9 | 95.5 | 98.8 | 89 | 82.2 | 56.3 | 52.5 | 60.4 | 50.6 | 89.2 | 55 | 79.4 | |
| ColPali v1.32026.06 | 83.3 | 58.4 | 85.5 | 77.3 | 97.4 | 94.6 | 96.1 | 97.4 | 86.7 | 70.8 | 54.6 | 54.9 | 58.5 | 48.6 | 84.8 | 54.2 | 76 | |
| ColSmol-500M2026.06 | 74.9 | 58 | 87.2 | 66.8 | 98.4 | 94.6 | 94.7 | 98 | 74.7 | 77.5 | 44.9 | 40.4 | 52.4 | 36.4 | 82.5 | 43.5 | 71.4 |