Geospatial Reasoning on IMAGEO-UPC (test)
23.9331City Accuracyo3
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| o32025.09 | 23.9331 | 45.7645 | 662.684 | 214.2736 | |
| Llama-3.2-90B2025.09 | 10.854 | 23.9756 | 706.8382 | 162.9549 | |
| Geo-R12025.09 | 10.1602 | 28.4631 | 840.6451 | 468.9504 | |
| Llama-4-17B2025.09 | 9.0444 | 24.8175 | 1,217.4863 | 534.2767 | |
| Qwen2.5-VL-32B2025.09 | 8.3333 | 22.161 | 1,163.9781 | 775.5446 | |
| Claude-3.5-haiku2025.09 | 8.2572 | 30.0048 | 697.1141 | 258.6857 | |
| Qwen2.5-VL-7B2025.09 | 7.0673 | 18.5478 | 1,411.9406 | 862.6727 | |
| Llama-3.2-11B2025.09 | 3.3194 | 18.931 | 955.5379 | 353.2175 |