Document Question Answering on LongDocURL
71.4Accuracy (All)GPT-4o-200b-128
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-4o-200b-128Retrieval=Ground-Truth2025.10 | 71.4 | 74.6 | 68.6 | |
| GPT-4o-200b-128Retrieval=LAD-RAG2025.10 | 65.9 | 72.4 | 59.9 | |
| GPT-4o-200b-128Retrieval=topk-adjusted2025.10 | 65.2 | 70.9 | 60 | |
| Pixtral-12B-2409Retrieval=Ground-Truth2025.10 | 63.4 | 66.8 | 60.3 | |
| Phi-3.5-Vision-4BRetrieval=Ground-Truth2025.10 | 63.1 | 65.9 | 60.6 | |
| InternVL2-8BRetrieval=Ground-Truth2025.10 | 62.9 | 68.4 | 58 | |
| GPT-4o-200b-128Retrieval=retrieving@102025.10 | 62.2 | 70.2 | 55.2 | |
| GPT-4o-200b-128Retrieval=retrieving@52025.10 | 59 | 68.4 | 51 | |
| MAB-DQARAG Method=ColPali (Top-4)2026.04 | 56.4 | — | — | |
| MoloRAGRAG Method=ColPali (Top-4)2026.04 | 53.6 | — | — | |
| MoloRAG+RAG Method=MoloRAG+ (Top-4)2026.04 | 52.8 | — | — | |
| MDocAgentRAG Method=ColPali + ColBert2026.04 | 52.7 | — | — | |
| Pixtral-12B-2409Retrieval=LAD-RAG2025.10 | 50.7 | 55.1 | 46.8 | |
| M3DocRAGRAG Method=ColPali (Top-4)2026.04 | 50.3 | — | — | |
| Phi-3.5-Vision-4BRetrieval=LAD-RAG2025.10 | 48.9 | 49.3 | 47.6 | |
| Phi-3.5-Vision-4BRetrieval=retrieving@102025.10 | 47.9 | 48.3 | 47.6 | |
| InternVL2-8BRetrieval=LAD-RAG2025.10 | 47.7 | 51.8 | 43.8 | |
| Phi-3.5-Vision-4BRetrieval=retrieving@52025.10 | 47.6 | 48.5 | 46.8 | |
| Phi-3.5-Vision-4BRetrieval=topk-adjusted2025.10 | 46.9 | 48.4 | 45.5 | |
| InternVL2-8BRetrieval=topk-adjusted2025.10 | 46.8 | 51.5 | 41.1 | |
| InternVL2-8BRetrieval=retrieving@102025.10 | 45.7 | 49.9 | 42 | |
| Pixtral-12B-2409Retrieval=topk-adjusted2025.10 | 45.5 | 48.8 | 42.3 | |
| InternVL2-8BRetrieval=retrieving@52025.10 | 44.3 | 48.4 | 40.4 | |
| Pixtral-12B-2409Retrieval=retrieving@52025.10 | 43 | 45.8 | 40.1 | |
| Pixtral-12B-2409Retrieval=retrieving@102025.10 | 42.7 | 45.7 | 40 | |
| Qwen-2.5-VL-7BRAG Method=Direct2026.04 | 39.8 | — | — | |
| LLaVA-1.6-7BRAG Method=Direct2026.04 | 11 | — | — | |
| MiniCPM-Llama3-V2.5-8BRetrieval=All-Pages2025.10 | 6 | 6.6 | 5.3 | |
| Idefics2-8BRetrieval=All-Pages2025.10 | 4.5 | 5.4 | 3.8 | |
| mPLUG-DocOwl 1.5-8BRetrieval=All-Pages2025.10 | 3.1 | 3.9 | 2.4 |