GEOQUERY
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
GeoQuery (i.i.d.)
93.6Exact Match Accuracy
32
GeoQuery compositional
89.5Accuracy
29
GeoQuery (Len.)
74.3Exact Match Accuracy
17
Geoquery
83Exact Match Accuracy
17
GeoQuery
84.64Accuracy
14
Geoquery (test)
91.1Accuracy
14
GeoQuery (TMCD)
82.8Exact Match Acc
12
GEOQUERY template (test)
0.83Accuracy
12
GeoQuery Few-shot 32 examples (test)
95.7Program Accuracy
8
GeoQuery (Templ.)
85.9Exact Match Accuracy
8
GeoQuery
64.82T-EM
7
GEOQUERY 280-sentence Geo880 (test)
96.3Precision
7
GeoQuery Length split
95.7Execution Accuracy
6
GeoQuery
77.9Template Accuracy
6
GeoQuery (Template)
79Accuracy
4
GeoQuery NewFunc
0.962Exec Acc
3
GeoQuery Template split
97.9Execution Accuracy
3