Visual Document Retrieval on M3DocVQA
62.65Recall@1NV-Embed-V2
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| NV-Embed-V2Vector Type=Single-Vector, FLOPs=0.3362025.10 | 62.65 | 85.77 | |
| GMEVector Type=Single-Vector, FLOPs=0.1262025.10 | 59.85 | 77.83 | |
| HEAVEN (only Stage 1)Vector Type=Single-Vector, FLOPs=0.0262025.10 | 59.4 | 73.96 | |
| ColQwen2Vector Type=Multi-Vector, FLOPs=288.5072025.10 | 59.32 | 80.69 | |
| HEAVENVector Type=Multi-Vector, FLOPs=0.5452025.10 | 59.31 | 78.66 | |
| ColPaliVector Type=Multi-Vector, FLOPs=398.2952025.10 | 58.01 | 78.65 | |
| ColQwen2.5Vector Type=Multi-Vector, FLOPs=288.5072025.10 | 57.99 | 78.73 | |
| BGE-M3 (dense)Vector Type=Single-Vector, FLOPs=0.0842025.10 | 57.56 | 77.11 | |
| BGE-M3 (multi)Vector Type=Multi-Vector, FLOPs=1408.1102025.10 | 56.88 | 76.96 | |
| DSEVector Type=Single-Vector, FLOPs=0.1262025.10 | 55.14 | 71.3 | |
| VisRAGVector Type=Single-Vector, FLOPs=0.1892025.10 | 50.39 | 69.59 |