Document Understanding on LongDocURL (Granular Metrics)
65.1Accuracy (TXT)MLDocRAG
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| MLDocRAGType=Graph/Agentic RAG2026.06 | 65.1 | 39.4 | 48.3 | 41.1 | 66.9 | 56.3 | 23.4 | 50.8 | |
| MAGE-RAGType=Graph/Agentic RAG2026.06 | 59.82 | 45.08 | 51 | 51.6 | 58.44 | 47.69 | 51.95 | 52.75 | |
| G2ReaderType=Graph/Agentic RAG2026.06 | 57.82 | 38.38 | 46.69 | 50.95 | 54.31 | 47.44 | 45.24 | 50.67 | |
| Direct MLLMType=Direct MLLM2026.06 | 57.49 | 41.74 | 50.21 | 47.29 | 51.91 | 48.44 | 48.32 | 50.07 | |
| M3DocRAGType=Page-level Visual RAG2026.06 | 56.2 | 43.04 | 50.49 | 45.62 | 53.47 | 45.77 | 48.51 | 49.35 | |
| EVisRAGType=Page-level Visual RAG2026.06 | 48.56 | 34.21 | 41.1 | 41.41 | 47.36 | 37.01 | 42.09 | 41.84 | |
| BM25Type=Text RAG2026.06 | 44.74 | 32.54 | 37.68 | 30.71 | 38.24 | 34.57 | 37.84 | 36.26 | |
| ColBERTv2Type=Text RAG2026.06 | 41.81 | 29.71 | 32.46 | 22.67 | 30.08 | 33.27 | 32.52 | 31.74 |