Document Question Answering on MMLongBench-Doc (test)
49.09AccuracyMDocAgent (w/ EviProp Retriever)
Evaluation results
| Method | Links | |
|---|---|---|
| MDocAgent (w/ EviProp Retriever)Backbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 49.09 | |
| MoLoRAG (w/ EviProp Retriever)Backbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 48.69 | |
| EviPropBackbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 47.75 | |
| MoLoRAG (Original ColPali)Backbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 47.38 | |
| MDocAgent (Original ColPali)Backbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 46.8 | |
| M3DocRAGBackbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 45.29 | |
| Direct InferenceBackbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 44.88 | |
| MoLoRAG (w/ EviProp Retriever)Backbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 39.27 | |
| MDocAgent (w/ EviProp Retriever)Backbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 39.01 | |
| EviPropBackbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 38.34 | |
| MoLoRAG (Original ColPali)Backbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 38.17 | |
| MDocAgent (Original ColPali)Backbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 38 | |
| M3DocRAGBackbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 36.23 | |
| Direct InferenceBackbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 32.77 | |
| Text RAGBackbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 32.57 | |
| Text RAGBackbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 30.9 |