Geospatial Reasoning on GeoMMBench (test)
88.4AccuracyGeoMMAgent
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GeoMMAgentInput Modality=Multimodal2026.04 | 88.4 | 87.6 | 89.8 | 93.2 | 97.6 | 78.2 | 94 | 91.2 | 89.2 | 74.2 | 89.3 | 92.2 | 82.9 | 97.3 | 76.9 | 97.8 | 83.1 | |
| GeoChatInput Modality=Multimodal, Model Access=Open-source2026.04 | 35.4 | 34.1 | 40.9 | 34.1 | 34.1 | 41.7 | 22.8 | 34.6 | 27 | 46.8 | 21.4 | 31.1 | 36.8 | 29.7 | 26.9 | 30.4 | 33.9 | |
| GPT-4 TextInput Modality=Text-only, Model Access=Closed-source2026.04 | 31.2 | 27.4 | 49.6 | 36.4 | 45.9 | 19.9 | 29.9 | 26.4 | 32.4 | 35.5 | 35.7 | 30.8 | 27.1 | 16.2 | 7.7 | 30.4 | 30.5 | |
| Random2026.04 | 25.2 | 25.3 | 25.2 | 25 | 22.4 | 27.2 | 20.4 | 24.5 | 35.1 | 16.1 | 32.1 | 23.2 | 23.7 | 35.1 | 42.3 | 28.3 | 26.3 |