Geolocation on WanderBench Street level
52.4Accuracyo3
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| o3Model Type=Closed Source LMMs2026.03 | 52.4 | 52.5 | 52.5 | |
| Gemini-2.5 FlashModel Type=Closed Source LMMs2026.03 | 50.4 | 50.5 | 50.5 | |
| Gemini-2.5 ProModel Type=Closed Source LMMs2026.03 | 49.5 | 49.6 | 49.5 | |
| GPT-4oModel Type=Closed Source LMMs2026.03 | 40.3 | 40.4 | 40.4 | |
| GLM-4.5VModel Type=Open Source LMMs2026.03 | 35.7 | 35.9 | 35.8 | |
| Qwen2VL-72BModel Type=Open Source LMMs2026.03 | 27 | 23.3 | 25 | |
| Qwen2.5VL-32BModel Type=Open Source LMMs2026.03 | 26 | 22.4 | 24.1 | |
| Qwen2.5VL-72BModel Type=Open Source LMMs2026.03 | 25.7 | 22.1 | 23.8 | |
| GeoCLIP-top5Model Type=Retrieval Based2026.03 | 23.2 | 23.3 | 23.3 | |
| Gemma-3-27BModel Type=Open Source LMMs2026.03 | 20.7 | 17.8 | 19.1 | |
| LLaMA-4-MaverickModel Type=Open Source LMMs2026.03 | 19.8 | 19.9 | 19.8 | |
| Qwen2.5-VL-7BModel Type=Open Source LMMs2026.03 | 18.8 | 16.2 | 17.4 | |
| LLaMA-3.2-90B-VModel Type=Open Source LMMs2026.03 | 18.7 | 18.8 | 18.8 | |
| QwenVL-MaxModel Type=Closed Source LMMs2026.03 | 18 | 18 | 18 | |
| InternVL3-78BModel Type=Open Source LMMs2026.03 | 17.1 | 14.8 | 15.9 | |
| InternVL2.5-78BModel Type=Open Source LMMs2026.03 | 16.4 | 14.1 | 15.2 | |
| GeoCLIPModel Type=Retrieval Based2026.03 | 15.8 | 15.8 | 15.8 | |
| Claude Sonnet 4Model Type=Closed Source LMMs2026.03 | 13.8 | 13.9 | 13.9 | |
| Claude Haiku 4.5Model Type=Closed Source LMMs2026.03 | 13.4 | 13.4 | 13.4 | |
| LLaVA-OV-72BModel Type=Open Source LMMs2026.03 | 11.2 | 9.7 | 10.4 | |
| Qwen2VL-7BModel Type=Open Source LMMs2026.03 | 11 | 9.4 | 10.1 |