List your company

Layout Retrieval on MMDocIR 1.0 (full)

39Macro Recall@1Qwen3-VL-8B
18.51223.83129.1534.469May 26, 2026

Evaluation results

MethodLinks
Qwen3-VL-8BScoring=LVLM attn., Attention strategy=selected heads (MMRetHeads)2026.053964.974.239.367.176.6
ColPaliScoring=Image2026.0532.7546232.554.363.2
ColBERTScoring=VLM-text2026.0531.354.461.931.45663.7
Col-Phi3MMDocIRScoring=Image2026.0531.152.361.131.654.563.3
DPR-Phi3MMDocIRScoring=Image2026.0529.551.660.230.253.962.8
BGEScoring=VLM-text2026.0528.351.860.32953.262.4
ContrieverScoring=VLM-text2026.0528.351.760.428.95362.2
DSEwiki-ssScoring=Image2026.0528.250.258.529.252.161.1
Gemma3-12BScoring=LVLM attn., Attention strategy=selected heads (MMRetHeads)2026.0528.255.264.727.655.266.1
DSEdocmatixScoring=Image2026.0527.949.857.529.151.959.9
E5Scoring=VLM-text2026.0526.751.160.426.451.861.2
GTEScoring=VLM-text2026.0526.151.360.727.152.362.2
DPRScoring=VLM-text2026.0519.339.849.519.240.450.5