Geolocation on GeoBrowse Level 1 Visual Cues
24City AccuracyGATE
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GATEBackbone=Gemini-3-Pro2026.04 | 24 | 42.6 | 65.2 | 48.2 | |
| PyvisionFramework=Open Source Agents2026.04 | 15.4 | 20 | 43.5 | 29.6 | |
| GATEBackbone=Claude-4.5-Opus2026.04 | 15.4 | 32.7 | 63 | 42.2 | |
| Gemini-3-ProFramework=Direct Inference2026.04 | 13.5 | 27.3 | 53.3 | 35.7 | |
| Claude-4.5-OpusFramework=Direct Inference2026.04 | 13.5 | 23.6 | 43.4 | 30.2 | |
| GATEBackbone=Gemini-2.5-Pro2026.04 | 13.5 | 23.6 | 52.2 | 35.7 | |
| GPT-5Framework=Direct Inference2026.04 | 11.5 | 21.8 | 38 | 27.6 | |
| Gemini-2.5-ProFramework=Direct Inference2026.04 | 11.5 | 21.8 | 41.3 | 28.1 | |
| GATEBackbone=GPT-52026.04 | 11.5 | 23.6 | 65.2 | 39.7 | |
| OmniSearchFramework=Open Source Agents2026.04 | 9.6 | 18.2 | 37 | 24.6 | |
| GPT-5.2Framework=Direct Inference2026.04 | 7.7 | 9.1 | 30.4 | 18.6 | |
| Gemini-2.5-flashFramework=Direct Inference2026.04 | 7.7 | 18.2 | 40.2 | 22.6 | |
| Qwen-3-VL-32BFramework=Direct Inference2026.04 | 7.7 | 16.4 | 16.3 | 14.1 | |
| WebWatcherFramework=Open Source Agents2026.04 | 7.7 | 18.2 | 38 | 24.6 | |
| GATEBackbone=GPT-4o2026.04 | 7.7 | 20 | 52.2 | 31.8 | |
| GATEBackbone=GPT-4.12026.04 | 7.7 | 20 | 45.7 | 28.6 | |
| GATEBackbone=Qwen-3-VL-32B2026.04 | 7.7 | 12.7 | 30.4 | 19.6 | |
| GPT-4oFramework=Direct Inference2026.04 | 5.8 | 16.4 | 35.7 | 23.1 | |
| GPT-4.1Framework=Direct Inference2026.04 | 5.8 | 14.5 | 30.4 | 19.6 | |
| Llama-3.2-90BFramework=Direct Inference2026.04 | 3.8 | 10.9 | 19.6 | 13.1 | |
| Qwen-2.5-VL-32BFramework=Direct Inference2026.04 | 3.8 | 9.1 | 17.3 | 11.1 | |
| GATEBackbone=Llama-3.2-90B2026.04 | 3.8 | 10.9 | 19.6 | 13.1 | |
| GATEBackbone=Qwen-2.5-VL-7B2026.04 | 3.8 | 9.1 | 13 | 9.5 | |
| Qwen-2.5-VL-7BFramework=Direct Inference2026.04 | 1.9 | 6.3 | 11.1 | 7.5 |