Earth Observation analysis on Earth-Agent
0.7798Tool-A-ODeepSeek-V3.1
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DeepSeek-V3.1Method Variant=Base2026.01 | 0.7798 | 0.6433 | 0.5001 | 2.66 | 0.5223 | |
| GPT-5Method Variant=Base2026.01 | 0.7116 | 0.6068 | 0.4579 | 2.84 | 0.6316 | |
| GeoEvolverBackbone=GPT-5, Method Variant=+Ours2026.01 | 0.6752 | 0.5311 | 0.4014 | 1.5 | 0.7085 | |
| GPT-4oMethod Variant=Base2026.01 | 0.6688 | 0.532 | 0.4747 | 2.61 | 0.4494 | |
| GeoEvolverBackbone=Qwen3-32B, Method Variant=+Ours2026.01 | 0.6284 | 0.4938 | 0.4232 | 0.99 | 0.4696 | |
| GeoEvolverBackbone=GPT-4o, Method Variant=+Ours2026.01 | 0.6271 | 0.4893 | 0.3745 | 1.56 | 0.6559 | |
| GeoEvolverBackbone=DeepSeek-V3.1, Method Variant=+Ours2026.01 | 0.6185 | 0.4792 | 0.3739 | 1.49 | 0.5968 | |
| Gemini-2.5Method Variant=Base2026.01 | 0.618 | 0.5078 | 0.4092 | 2.6 | 0.5506 | |
| GeoEvolverBackbone=Gemini-2.5, Method Variant=+Ours2026.01 | 0.6143 | 0.536 | 0.3863 | 1.65 | 0.5991 | |
| Qwen3-32BMethod Variant=Base2026.01 | 0.4239 | 0.3379 | 0.261 | 1.9 | 0.248 |