Toponym Disambiguation on Gold-standard toponym dataset GPE
90.2PrecisionGPT-4o
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-4oCategory=LLM2026.02 | 90.2 | 100 | 94.8 | |
| LLaMA2-7bCategory=LLM2026.02 | 78.4 | 100 | 87.9 | |
| Phi-3Category=LLM2026.02 | 76.5 | 94.9 | 84.7 | |
| Mordecai3Category=Geoparser2026.02 | 59.5 | 61.1 | 60.3 | |
| Gate YodieCategory=Geoparser2026.02 | 42.5 | 60.7 | 50 | |
| DBpediaCategory=Geoparser2026.02 | 38.1 | 64 | 47.8 | |
| CliffCategory=Geoparser2026.02 | 37.5 | 85.7 | 52.2 | |
| EdinburghCategory=Geoparser2026.02 | 35.6 | 72.7 | 47.8 | |
| GeoparsepyCategory=Geoparser2026.02 | 29.2 | 82.4 | 43.1 |