Document Visual Question Answering on PubMed Central (PMC) post-February 16, 2026 (test)
65.1Top-5 AccuracyBGE-M3
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| BGE-M3Preproc.=Idx+Emb^{C+G}2026.05 | 65.1 | 57.1 | 51.9 | — | — | — | |
| Jina-v4Preproc.=Idx+Emb^{C+G}2026.05 | 64.9 | 57.9 | 52.1 | — | — | — | |
| Qwen3-EmbPreproc.=Idx+Emb^{C+G}2026.05 | 64.4 | 56.5 | 51.1 | — | — | — | |
| Jina-v4-MMPreproc.=Idx+Emb^{C+G}2026.05 | 63.7 | 54.6 | 50.3 | — | — | — | |
| BM25Preproc.=Idx^C2026.05 | 62.5 | 55.7 | 50.8 | — | — | — | |
| ColPaliPreproc.=Idx+Emb^{C+G}2026.05 | 56.1 | 46.6 | 41.9 | — | — | — | |
| LensVLMPreproc.=Rend.^C2026.05 | — | — | — | 68.9 | 62.1 | 52.1 | |
| LensVLMSFTPreproc.=Rend.^C2026.05 | — | — | — | 63.7 | 56.9 | 45.7 |