Geospatial Question Answering on In-Distribution MCQ New York City v1 (test)
51.7POI LookupGeoResponder
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GeoResponderBackbone=Mistral2025.09 | 51.7 | 56.8 | 68.5 | 71.4 | 74.9 | 72.3 | |
| GeoResponderBackbone=LLaMa2025.09 | 46 | 45 | 60 | 61 | 60 | 61 | |
| GeoResponderBackbone=Qwen2025.09 | 43.7 | 39.4 | 60.2 | 63.2 | 47.6 | 61.4 | |
| CityGPT2025.09 | 33 | 24.7 | 31 | 23 | 26.5 | 27.4 |