Multimodal Document Question Answering on MMLongBench (test)
34.7Chart Acc.MMGraphRAG
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| MMGraphRAGBackbone=L-Iv2025.07 | 34.7 | 36.9 | 36.6 | 31.9 | 12.9 | 28.5 | 38.7 | 21.9 | 59.2 | |
| MMGraphRAGBackbone=Q-Iv2025.07 | 34.7 | 38.8 | 36.5 | 33.8 | 28.7 | 34.6 | 39.6 | 26.7 | 55.8 | |
| MMGraphRAGBackbone=L-Qv2025.07 | 26.4 | 32.6 | 29.2 | 26.4 | 13.8 | 21.2 | 37.6 | 13.8 | 55.2 | |
| MMGraphRAGBackbone=Q-Qv2025.07 | 26.2 | 34.8 | 30 | 29.3 | 29.1 | 29.2 | 38.7 | 20.1 | 51.6 | |
| LLMBackbone=Q2025.07 | 16.8 | 27.8 | 12.6 | 33.3 | 23.5 | 16.1 | 22.5 | 20 | 53.2 | |
| LLMBackbone=L2025.07 | 16.3 | 28.2 | 12.7 | 32.1 | 21.9 | 17.4 | 23.7 | 20.3 | 51.6 | |
| NaiveRAGBackbone=L2025.07 | 16.3 | 29.2 | 15.3 | 31 | 22.7 | 18.7 | 24.9 | 19.5 | 56.5 | |
| NaiveRAGBackbone=Q2025.07 | 15.1 | 26.2 | 10.8 | 30.3 | 20.3 | 14.9 | 22.3 | 16.4 | 52.5 | |
| GraphRAGBackbone=Q2025.07 | 14 | 28.1 | 11 | 26.1 | 12.2 | 8.5 | 18.2 | 13.2 | 77.1 | |
| MLLMBackbone=Iv2025.07 | 8.8 | 11.6 | 8.1 | 10.7 | 11.8 | 11.4 | 13.3 | 7.9 | 13.9 | |
| MLLMBackbone=Qv2025.07 | 7.6 | 10 | 5.4 | 10 | 8.8 | 12.7 | 10.8 | 9.9 | 8.1 | |
| GraphRAGBackbone=L2025.07 | 7.6 | 27.2 | 6.7 | 25.1 | 15 | 10.6 | 16.3 | 12.3 | 78.5 |