Visual Document Retrieval on MIRACL Vision
0.7204Chinesenemotron-colembed-vl-8b-v2
Evaluation Results
| Method | Links | |||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| nemotron-colembed-vl-8b-v2Backbone=8B, Version=v22026.02 | 0.7204 | 0.7863 | 0.616 | 0.748 | 0.5289 | 0.8726 | 0.8171 | 0.7233 | 0.5902 | 0.668 | 0.869 | 0.7316 | 0.8399 | 0.7089 | 0.7422 | 0.1899 | 0.6699 | 0.5252 | 0.686 | |
| nemo-vl-8b-v2Model Size=8B, Version=v22026.06 | 0.7204 | — | — | 0.748 | — | 0.8726 | 0.8171 | 0.7233 | — | 0.668 | 0.869 | — | 0.8399 | 0.7089 | — | — | — | 0.5252 | 0.7492 | |
| Argus-9BModel Size=9B2026.06 | 0.6851 | — | — | 0.7149 | — | 0.8519 | 0.8301 | 0.7236 | — | 0.6125 | 0.775 | — | 0.8184 | 0.7307 | — | — | — | 0.8099 | 0.7552 | |
| nemotron-colembed-vl-4b-v2Backbone=4B, Version=v22026.02 | 0.6697 | 0.6028 | 0.5156 | 0.7246 | 0.4266 | 0.8398 | 0.7943 | 0.71 | 0.5338 | 0.648 | 0.8326 | 0.6136 | 0.7879 | 0.7033 | 0.6886 | 0.1579 | 0.5928 | 0.4469 | 0.6272 | |
| nemo-vl-4b-v2Model Size=4B, Version=v22026.06 | 0.6697 | — | — | 0.7246 | — | 0.8398 | 0.7943 | 0.71 | — | 0.648 | 0.8326 | — | 0.7879 | 0.7033 | — | — | — | 0.4469 | 0.7157 | |
| gme-Qwen2-VL-2B-InstructBackbone=Qwen2-VL-2B2026.02 | 0.6314 | 0.4888 | 0.3755 | 0.6784 | 0.3085 | 0.6863 | 0.6851 | 0.6345 | 0.3127 | 0.5416 | 0.7305 | 0.6202 | 0.7202 | 0.6277 | 0.5348 | 0.0893 | 0.3563 | 0.4884 | 0.5283 | |
| gme-Qwen2-VL-2BModel Size=2B2026.06 | 0.6314 | — | — | 0.6784 | — | 0.6863 | 0.6851 | 0.6345 | — | 0.5416 | 0.7305 | — | 0.7202 | 0.6277 | — | — | — | 0.4884 | 0.6424 | |
| vdr-2b-multi-v1Backbone=2B2026.02 | 0.5963 | 0.4379 | 0.2473 | 0.6784 | 0.2398 | 0.5283 | 0.7194 | 0.6205 | 0.2058 | 0.5254 | 0.6553 | 0.4952 | 0.6995 | 0.6274 | 0.4509 | 0.0318 | 0.3177 | 0.4577 | 0.4741 | |
| vdr-2b-multi-v1Model Size=2B2026.06 | 0.5963 | — | — | 0.6784 | — | 0.5283 | 0.7194 | 0.6205 | — | 0.5254 | 0.6553 | — | 0.6995 | 0.6274 | — | — | — | 0.4577 | 0.6108 | |
| dse-qwen2-2b-mrl-v1Backbone=Qwen2-2B2026.02 | 0.5962 | 0.3893 | 0.2352 | 0.6605 | 0.225 | 0.4162 | 0.716 | 0.6267 | 0.174 | 0.4866 | 0.6232 | 0.4446 | 0.6505 | 0.5927 | 0.4156 | 0.0274 | 0.2692 | 0.4178 | 0.4426 | |
| dse-qwen2-2b-mrl-v1Model Size=2B2026.06 | 0.5962 | — | — | 0.6605 | — | 0.4162 | 0.716 | 0.6267 | — | 0.4866 | 0.6232 | — | 0.6505 | 0.5927 | — | — | — | 0.4178 | 0.5786 | |
| colqwen2-v1.0Backbone=Qwen22026.02 | 0.4926 | 0.4129 | 0.2888 | 0.6417 | 0.2616 | 0.6604 | 0.6876 | 0.5995 | 0.2209 | 0.532 | 0.697 | 0.4419 | 0.6811 | 0.6224 | 0.4931 | 0.0264 | 0.2389 | 0.512 | 0.4728 | |
| colqwen2-v1.0Version=v1.02026.06 | 0.4926 | — | — | 0.6417 | — | 0.6604 | 0.6876 | 0.5995 | — | 0.532 | 0.697 | — | 0.6811 | 0.6224 | — | — | — | 0.512 | 0.6126 | |
| nemoretriever-colembed-3b-v2Backbone=3B, Version=v22026.02 | 0.4878 | 0.525 | 0.5391 | 0.7397 | 0.357 | 0.8541 | 0.7943 | 0.6924 | 0.5319 | 0.655 | 0.7493 | 0.5394 | 0.792 | 0.7236 | 0.7495 | 0.2325 | 0.4727 | 0.5943 | 0.6127 | |
| nemo-cb-3b-v2Model Size=3B, Version=v22026.06 | 0.4878 | — | — | 0.7397 | — | 0.8541 | 0.7943 | 0.6924 | — | 0.655 | 0.7493 | — | 0.792 | 0.7236 | — | — | — | 0.5943 | 0.7083 | |
| llama-nemoretriever-colembed-3b-v1Backbone=Llama 3B, Version=v12026.02 | 0.4355 | 0.4247 | 0.4878 | 0.7363 | 0.3109 | 0.8513 | 0.7988 | 0.6831 | 0.4867 | 0.6428 | 0.726 | 0.5158 | 0.767 | 0.7109 | 0.7767 | 0.1669 | 0.4035 | 0.5888 | 0.5841 | |
| llama-nemo-3b-v1Model Size=3B2026.06 | 0.4355 | — | — | 0.7363 | — | 0.8513 | 0.7988 | 0.6831 | — | 0.6428 | 0.726 | — | 0.767 | 0.7109 | — | — | — | 0.5888 | 0.6941 |