Geo-Bench
Benchmarks
TaskDatasetSOTA resultTrendResults
GEO-Bench in-domain
25.42Word Score
30
GEO-Bench
4.81WLV
26
GEO-Bench Qwen-plus
10.17Visual Fidelity Score
13
GEO-Bench Gemini-2.5-flash
15.35Visibility
13
GEO-Bench GPT-4o-mini
18.31Visual Fidelity
13
GEO-bench 1,000 queries (test)
11.07Word Score
12
GEO-Bench Subjective Average (test)
0.012VAR
12
GEO-Bench Objective Overall (test)
0.019VAR
12
GEO-Bench m-bigearthnet, m-so2sat, m-eurosat (test)
0.622F1 Score (GB-ben)
10
GEO-Bench SA-c
28.98Macro mIoU
10
Geo-Bench
82.98mIoU (nz-cattle, macro)
10
GEO-bench n=200 (test)
59.6Citation Rate
8
GEO-bench
22.3Relevance Score
2