Multiple-Choice Question (MCQ) on EarthMind-Bench Optical
96.24Scene Classification AccuracyEarth-OneVision
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Earth-OneVisionNumber of Parameters=2B2026.06 | 96.24 | 81.88 | 83.89 | 54.31 | 87.18 | 80.7 | |
| GPT-4oClosed-source=true2026.06 | 67.8 | 79.9 | 86.4 | 34 | 52.3 | 64.1 | |
| EarthMindNumber of Parameters=4B2026.06 | 64.3 | 77.5 | 83.6 | 50.1 | 33.1 | 61.7 | |
| EarthDialNumber of Parameters=4B2026.06 | 58.2 | 72.4 | 75.9 | 40.6 | 44.2 | 58.3 | |
| GeoPixelNumber of Parameters=7B2026.06 | 55.3 | 67.8 | 73.6 | 33.5 | 34.7 | 53 | |
| GeoChatNumber of Parameters=7B2026.06 | 40.9 | 51.8 | 46.8 | 18.9 | 19 | 35.5 |