Geologic Map Understanding on GeoMap-Bench (USGS Set)
0.887Extraction ScoreGeoMap-Agent
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GeoMap-Agent2025.01 | 0.887 | 0.935 | 0.949 | 0.581 | 0.817 | 0.833 | |
| GPT-4o2025.01 | 0.208 | 0.1 | 0.398 | 0.494 | 0.683 | 0.376 | |
| GPT-4o-mini2025.01 | 0.183 | 0.05 | 0.278 | 0.456 | 0.512 | 0.295 | |
| QWen-chat2025.01 | 0.05 | 0.003 | 0.253 | 0.442 | 0.25 | 0.199 | |
| GLM-4vParameters=9b2025.01 | 0.05 | 0.01 | 0.258 | 0.212 | 0.6 | 0.226 | |
| Monkey-chat2025.01 | 0.042 | 0.01 | 0.213 | 0.349 | 0.267 | 0.176 | |
| Cogvlm2-llama3-chatParameters=19B2025.01 | 0.033 | 0 | 0.189 | 0.177 | 0.067 | 0.093 | |
| Idefics-instructParameters=9b2025.01 | 0.025 | 0 | 0.247 | 0.26 | 0.333 | 0.173 | |
| Random2025.01 | 0 | 0 | 0.25 | 0.25 | 0 | 0.1 |