Document Question Answering on PlotQA (test)
53.79AccuracyOracle
Evaluation results
| Method | Links | |
|---|---|---|
| OracleModel=MiniCPM-V 2.62026.02 | 53.79 | |
| MARAModel=MiniCPM-V 2.62026.02 | 44.57 | |
| OracleModel=GPT-4o2026.02 | 44.25 | |
| VisRAGModel=MiniCPM-V 2.6, Input=top-12026.02 | 42.89 | |
| MARA (Our Framework)Model=MiniCPM-V 2.6, Input=top-12026.02 | 42.89 | |
| MARA (Our Framework)Model=MiniCPM-V 2.6, Input=top-32026.02 | 40.05 | |
| VisRAGModel=MiniCPM-V 2.6, Input=top-32026.02 | 37.57 | |
| VisRAGModel=MiniCPM-V 2.6, Input=top-102026.02 | 35.12 | |
| VisRAGModel=GPT-4o, Input=top-12026.02 | 33.73 | |
| MARA (Our Framework)Model=GPT-4o, Input=top-12026.02 | 33.41 | |
| MARAModel=GPT-4o2026.02 | 32.98 | |
| MARA (Our Framework)Model=MiniCPM-V 2.6, Input=top-102026.02 | 32.96 | |
| MARA (Our Framework)Model=GPT-4o, Input=top-32026.02 | 32.18 | |
| VisRAGModel=GPT-4o, Input=top-32026.02 | 30.12 |