List your company

Page Retrieval on MMDocIR 1.0 (full)

64.7Macro R@1Qwen3-VL-8B
25.735.82545.9556.075May 26, 2026

Evaluation results

MethodLinks
Qwen3-VL-8BScoring=LVLM attn., Attention strategy=selected heads (MMRetHeads)2026.0564.783.888.964.583.688.9
Qwen3-VL-8BScoring=LVLM attn., Attention strategy=all-head attention2026.0561.881.287.561.281.287.7
Col-Phi3MMDocIRScoring=Image2026.055776.382.257.176.883
DPR-Phi3MMDocIRScoring=Image2026.0554.173.581.153.774.381.8
ColPaliScoring=Image2026.055374.780.852.77581
Gemma3-12BScoring=LVLM attn., Attention strategy=selected heads (MMRetHeads)2026.0551.873.480.252.473.480.7
DSEdocmatixScoring=Image2026.0550.271.479.550.171.880.1
Gemma3-12BScoring=LVLM attn., Attention strategy=all-global attention2026.0549.47178.65070.878.9
DSEwiki-ssScoring=Image2026.054870.678.547.571.479.2
ColBERTScoring=VLM-text2026.0545.864.972.344.964.872.3
ContrieverScoring=VLM-text2026.0540.960.669.239.759.768.3
E5Scoring=VLM-text2026.0540.860.369.139.559.367.9
BGEScoring=VLM-text2026.0540.659.768.439.659.668.5
GTEScoring=VLM-text2026.0538.958.767.637.958.367.2
DPRScoring=VLM-text2026.0527.246.357.826.946.257.8