Document Question Answering on PathSpatial-DocQA
80.9ACSLAMMI
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LAMMIAdaptation=TA+PE, Planner=InternVL3.5 8B2026.02 | 80.9 | 33.8 | 0 | |
| ReACTAdaptation=PE, Planner=InternVL3.5 8B2026.02 | 79.8 | 30.1 | 0 | |
| LAMMIAdaptation=TA+PE, Planner=Qwen3 VL 8B Instruct2026.02 | 77.7 | 23.8 | 5.6 | |
| OpenAI-Agents-SDKAdaptation=PE, Planner=GPT-52026.02 | 73.9 | 16.4 | 3.3 | |
| ReACTAdaptation=PE, Planner=MiniCPM-V 4.52026.02 | 71.5 | 35.3 | 1.8 | |
| ReACTAdaptation=PE, Planner=Qwen3 VL 8B Instruct2026.02 | 70.5 | 25.5 | 3.6 | |
| LAMMIAdaptation=TA+PE, Planner=MiniCPM-V 4.52026.02 | 67.6 | 20.5 | 12 | |
| MLLM-ToolsAdaptation=LoRA+PE, Planner=Vicuna v1.5 7B + ImageBind2026.02 | 57.8 | 38.7 | 6 | |
| MLLM-ToolsAdaptation=LoRA+PE, Planner=Qwen3 8B + ImageBind2026.02 | 49.8 | 23.1 | 60.3 | |
| MAT-AgentAdaptation=LoRA+PE, Planner=InternVL3.5 8B2026.02 | 46.2 | 66.2 | 4.9 | |
| MLLM-ToolsAdaptation=LoRA+PE, Planner=ToolACE 8B + ImageBind2026.02 | 44.8 | 54 | 37.4 | |
| MAT-AgentAdaptation=LoRA+PE, Planner=Qwen3 VL 8B Instruct2026.02 | 40.4 | 71.3 | 9.6 | |
| MAT-AgentAdaptation=LoRA+PE, Planner=MiniCPM-V 4.52026.02 | 37.3 | 66 | 23.8 |