Visual Document Retrieval on IRPAPERS
74.8NDCG@5NemColEmbed V2 8B
Evaluation results
| Method | Links | |
|---|---|---|
| NemColEmbed V2 8BSize=8B, Late Interaction=true, Neural Query Encoder=true2026.05 | 74.8 | |
| GME-Qwen2-7BSize=7B, Late Interaction=true2026.05 | 68.7 | |
| Qwen3-VL-Emb-2BSize=2B, Late Interaction=true2026.05 | 66.9 | |
| BM25 (unstr.)FLOPs=1.42026.05 | 65.7 | |
| V-SPLADE + BM25 (unstr.)Size=0.25B2026.05 | 64.6 | |
| V-SPLADE + BiModernVBERT + BM25 (unstr.)Size=0.25/0.25B, Neural Query Encoder=true2026.05 | 64.1 | |
| ColModernVBERTSize=0.25B, Late Interaction=true, Neural Query Encoder=true2026.05 | 62.6 | |
| ColPaliSize=3B, Late Interaction=true, Neural Query Encoder=true2026.05 | 58.6 | |
| BGE-M3 (unstr.)Size=0.57B, Late Interaction=true2026.05 | 55.7 | |
| V-SPLADE + BiModernVBERTSize=0.25/0.25B, Neural Query Encoder=true2026.05 | 55.7 | |
| V-SPLADE qualitySize=0.25B, FLOPs=1.92026.05 | 54 | |
| ColFlorSize=0.17B, Late Interaction=true, Neural Query Encoder=true2026.05 | 52.5 | |
| V-SPLADE efficientSize=0.25B, FLOPs=1.12026.05 | 47.1 | |
| BM25 (caption)FLOPs=1.32026.05 | 38.4 | |
| E5-VSize=8B, Late Interaction=true2026.05 | 37.2 | |
| BGE-M3 (caption)Size=0.57B, Late Interaction=true2026.05 | 37 | |
| BiModernVBERTSize=0.25B, Neural Query Encoder=true2026.05 | 31.8 | |
| Jina CLIP v2Size=0.9B, Neural Query Encoder=true2026.05 | 26.6 | |
| VLM2VecSize=4B, Late Interaction=true2026.05 | 17.1 | |
| SigLIP2-LSize=0.9B, Neural Query Encoder=true2026.05 | 13 | |
| JSDO-SparseSize=0.25B, Neural Query Encoder=true, FLOPs=18142026.05 | 2.6 | |
| D2SSize=0.25B, Neural Query Encoder=true, FLOPs=14.72026.05 | 0.6 |