Document Question Answering on LongDocURL (test)
55.52AccuracyMoLoRAG (w/ EviProp Retriever)
Evaluation results
| Method | Links | |
|---|---|---|
| MoLoRAG (w/ EviProp Retriever)Backbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 55.52 | |
| MDocAgent (w/ EviProp Retriever)Backbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 53.65 | |
| EviPropBackbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 53.52 | |
| MoLoRAG (Original ColPali)Backbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 53.21 | |
| MDocAgent (Original ColPali)Backbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 52.91 | |
| M3DocRAGBackbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 51.75 | |
| MoLoRAG (w/ EviProp Retriever)Backbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 51.17 | |
| EviPropBackbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 50.65 | |
| MDocAgent (w/ EviProp Retriever)Backbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 50.61 | |
| MoLoRAG (Original ColPali)Backbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 50.49 | |
| M3DocRAGBackbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 49.38 | |
| MDocAgent (Original ColPali)Backbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 46.91 | |
| Text RAGBackbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 39.79 | |
| Text RAGBackbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 36.61 | |
| Direct InferenceBackbone=Qwen3-VL-8B, Retrieval Setting=Top-32026.06 | 30.24 | |
| Direct InferenceBackbone=Qwen2.5-VL-7B, Retrieval Setting=Top-32026.06 | 26.38 |