Geospatial Question Answering on MapQA
62.45Overall ScoreSpatial-Agent
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Spatial-AgentType=Open-Source, Backbone=LlaMA-70B2026.01 | 62.45 | 54 | 84 | 58 | 76 | 64.71 | 38 | |
| Spatial-AgentType=Closed-Source, Backbone=GPT-4o-mini2026.01 | 61.45 | 52 | 82 | 56 | 74 | 64.71 | 40 | |
| Spatial-AgentType=Open-Source, Backbone=Qwen2.5-72B-Instruct2026.01 | 61.45 | 48 | 76 | 64 | 78 | 64.71 | 38 | |
| ReflexionType=Closed-Source, Backbone=GPT-4o-mini2026.01 | 53.79 | 50 | 80 | 30 | 64 | 64.71 | 34 | |
| ReActType=Closed-Source, Backbone=GPT-4o-mini2026.01 | 43.79 | 56 | 28 | 16 | 64 | 64.71 | 34 | |
| Direct LLMType=Closed-Source, Backbone=GPT-4o-mini2026.01 | 13.55 | 6 | 36 | 4 | 0 | 35.29 | 0 |