Geolocation on WanderBench City level
78.3AccuracyGemini-2.5 Pro
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Gemini-2.5 ProModel Type=Closed Source LMMs2026.03 | 78.3 | 78.4 | 78.3 | |
| Gemini-2.5 FlashModel Type=Closed Source LMMs2026.03 | 74.2 | 74.2 | 74.2 | |
| o3Model Type=Closed Source LMMs2026.03 | 73.4 | 73.4 | 73.4 | |
| GPT-4oModel Type=Closed Source LMMs2026.03 | 73 | 73 | 73 | |
| GLM-4.5VModel Type=Open Source LMMs2026.03 | 64 | 64 | 64 | |
| Qwen2.5VL-72BModel Type=Open Source LMMs2026.03 | 55 | 47.3 | 50.9 | |
| Qwen2VL-72BModel Type=Open Source LMMs2026.03 | 52.5 | 45.1 | 48.5 | |
| Qwen2.5VL-32BModel Type=Open Source LMMs2026.03 | 51.4 | 44.2 | 47.5 | |
| Qwen2.5-VL-7BModel Type=Open Source LMMs2026.03 | 43.3 | 37.2 | 40.1 | |
| Gemma-3-27BModel Type=Open Source LMMs2026.03 | 42.6 | 36.6 | 39.3 | |
| GeoCLIP-top5Model Type=Retrieval Based2026.03 | 39.2 | 39.2 | 39.2 | |
| LLaMA-4-MaverickModel Type=Open Source LMMs2026.03 | 37.2 | 37.2 | 37.2 | |
| InternVL2.5-78BModel Type=Open Source LMMs2026.03 | 36.8 | 31.6 | 34 | |
| QwenVL-MaxModel Type=Closed Source LMMs2026.03 | 36.2 | 36.1 | 36.2 | |
| InternVL3-78BModel Type=Open Source LMMs2026.03 | 35.9 | 30.9 | 33.2 | |
| LLaMA-3.2-90B-VModel Type=Open Source LMMs2026.03 | 35.4 | 35.5 | 35.5 | |
| Qwen2VL-7BModel Type=Open Source LMMs2026.03 | 34.1 | 29.2 | 31.5 | |
| GeoCLIPModel Type=Retrieval Based2026.03 | 30.2 | 30.2 | 30.2 | |
| Claude Sonnet 4Model Type=Closed Source LMMs2026.03 | 27 | 27.1 | 27.1 | |
| Claude Haiku 4.5Model Type=Closed Source LMMs2026.03 | 26.8 | 26.8 | 26.8 | |
| LLaVA-OV-72BModel Type=Open Source LMMs2026.03 | 24.1 | 20.6 | 22.2 |