Document Question Answering on FRAMES
10.5EMHiKEY
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| HiKEYMethod Category=Multimodal GraphRAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 10.5 | 14.6 | 17.7 | 15.4 | |
| MultiDocFusionMethod Category=Text chunk-based RAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 7.8 | 10.8 | 13.9 | 11.6 | |
| HopRAGMethod Category=Text-based GraphRAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 7.7 | 10.7 | 13.8 | 11.5 | |
| RAPTORMethod Category=Text-based GraphRAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 7.5 | 10.4 | 13.5 | 11.2 | |
| PageMethod Category=Text chunk-based RAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 7 | 9.8 | 12.7 | 10.6 | |
| Length chunkingMethod Category=Text chunk-based RAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 6.9 | 9.6 | 12.9 | 10.4 | |
| LumberChunkerMethod Category=Text chunk-based RAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 6.8 | 9.4 | 12.5 | 10.2 | |
| Meta ChunkerMethod Category=Text chunk-based RAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 6.8 | 9.4 | 12.5 | 10.2 | |
| Structural chunkingMethod Category=Text chunk-based RAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 6.4 | 8.9 | 12 | 9.7 | |
| SimpleDocMethod Category=Multimodal GraphRAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 4.9 | 6.8 | 9.9 | 7.6 | |
| MoLoRAGMethod Category=Multimodal GraphRAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 4.7 | 6.5 | 9.6 | 7.3 | |
| VDocRAGMethod Category=Page-level multimodal RAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 4.5 | 6.3 | 9.4 | 7.1 | |
| M3DocRAGMethod Category=Page-level multimodal RAG, Input budget=16K, LVLM Reader=same LVLM Reader2026.05 | 4.2 | 5.9 | 9 | 6.7 |