Visual Document Retrieval on MIRACL Vision

0.7204Chinesenemotron-colembed-vl-8b-v2

Evaluation results

Method
nemotron-colembed-vl-8b-v22026.02	0.7204	0.7863	0.616	0.748	0.5289	0.8726	0.8171	0.7233	0.5902	0.668	0.869	0.7316	0.8399	0.7089	0.7422	0.1899	0.6699	0.5252	0.686
nemo-vl-8b-v22026.06	0.7204	—	—	0.748	—	0.8726	0.8171	0.7233	—	0.668	0.869	—	0.8399	0.7089	—	—	—	0.5252	0.7492
Argus-9B2026.06	0.6851	—	—	0.7149	—	0.8519	0.8301	0.7236	—	0.6125	0.775	—	0.8184	0.7307	—	—	—	0.8099	0.7552
nemotron-colembed-vl-4b-v22026.02	0.6697	0.6028	0.5156	0.7246	0.4266	0.8398	0.7943	0.71	0.5338	0.648	0.8326	0.6136	0.7879	0.7033	0.6886	0.1579	0.5928	0.4469	0.6272
nemo-vl-4b-v22026.06	0.6697	—	—	0.7246	—	0.8398	0.7943	0.71	—	0.648	0.8326	—	0.7879	0.7033	—	—	—	0.4469	0.7157
gme-Qwen2-VL-2B-Instruct2026.02	0.6314	0.4888	0.3755	0.6784	0.3085	0.6863	0.6851	0.6345	0.3127	0.5416	0.7305	0.6202	0.7202	0.6277	0.5348	0.0893	0.3563	0.4884	0.5283
gme-Qwen2-VL-2B2026.06	0.6314	—	—	0.6784	—	0.6863	0.6851	0.6345	—	0.5416	0.7305	—	0.7202	0.6277	—	—	—	0.4884	0.6424
vdr-2b-multi-v12026.02	0.5963	0.4379	0.2473	0.6784	0.2398	0.5283	0.7194	0.6205	0.2058	0.5254	0.6553	0.4952	0.6995	0.6274	0.4509	0.0318	0.3177	0.4577	0.4741
vdr-2b-multi-v12026.06	0.5963	—	—	0.6784	—	0.5283	0.7194	0.6205	—	0.5254	0.6553	—	0.6995	0.6274	—	—	—	0.4577	0.6108
dse-qwen2-2b-mrl-v12026.02	0.5962	0.3893	0.2352	0.6605	0.225	0.4162	0.716	0.6267	0.174	0.4866	0.6232	0.4446	0.6505	0.5927	0.4156	0.0274	0.2692	0.4178	0.4426
dse-qwen2-2b-mrl-v12026.06	0.5962	—	—	0.6605	—	0.4162	0.716	0.6267	—	0.4866	0.6232	—	0.6505	0.5927	—	—	—	0.4178	0.5786
colqwen2-v1.02026.02	0.4926	0.4129	0.2888	0.6417	0.2616	0.6604	0.6876	0.5995	0.2209	0.532	0.697	0.4419	0.6811	0.6224	0.4931	0.0264	0.2389	0.512	0.4728
colqwen2-v1.02026.06	0.4926	—	—	0.6417	—	0.6604	0.6876	0.5995	—	0.532	0.697	—	0.6811	0.6224	—	—	—	0.512	0.6126
nemoretriever-colembed-3b-v22026.02	0.4878	0.525	0.5391	0.7397	0.357	0.8541	0.7943	0.6924	0.5319	0.655	0.7493	0.5394	0.792	0.7236	0.7495	0.2325	0.4727	0.5943	0.6127
nemo-cb-3b-v22026.06	0.4878	—	—	0.7397	—	0.8541	0.7943	0.6924	—	0.655	0.7493	—	0.792	0.7236	—	—	—	0.5943	0.7083
llama-nemoretriever-colembed-3b-v12026.02	0.4355	0.4247	0.4878	0.7363	0.3109	0.8513	0.7988	0.6831	0.4867	0.6428	0.726	0.5158	0.767	0.7109	0.7767	0.1669	0.4035	0.5888	0.5841
llama-nemo-3b-v12026.06	0.4355	—	—	0.7363	—	0.8513	0.7988	0.6831	—	0.6428	0.726	—	0.767	0.7109	—	—	—	0.5888	0.6941