Geologic map understanding on GeoMap-Bench CGS Set
77.7Extraction ScoreGeoMap-Agent
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GeoMap-Agent2025.01 | 77.7 | 90.6 | 82.4 | 59.5 | 84.6 | 78.9 | |
| GLM-4vParameters=9b2025.01 | 29.5 | 7.6 | 23.4 | 36.6 | 46.8 | 28.7 | |
| GPT-4o2025.01 | 23 | 15.7 | 35.9 | 52.1 | 54.2 | 36.1 | |
| Cogvlm2-llama3-chatParameters=19B2025.01 | 20.5 | 0 | 23.6 | 15.6 | 41.5 | 20.2 | |
| GPT-4o-mini2025.01 | 20.4 | 10.2 | 28.7 | 47.4 | 49.1 | 31.1 | |
| Monkey-chat2025.01 | 3.1 | 0.2 | 24.8 | 14.5 | 45.7 | 17.6 | |
| Random2025.01 | 0 | 0 | 25 | 25 | 0 | 10 | |
| QWen-chat2025.01 | 0 | 0.3 | 26.4 | 33.4 | 45.7 | 21.1 | |
| Idefics-instructParameters=9b2025.01 | 0 | 0 | 23.5 | 13.4 | 45.7 | 16.5 |