# Aggregate Spatial Task Performance on ZIP Code v1 (test)

Source: [Aggregate Spatial Task Performance on ZIP Code v1 (test)](<https://www.sota2.com/research/sota/aggregate-spatial-task-performance-on-zip-code-v1-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-02T07:50:45.158Z

Evaluation of model performance aggregating spatial task results using the test split of the ZIP Code v1 dataset, measured by metrics like R^2 and average performance across categories.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Aggregate Spatial Task Performance |
| Dataset (including any stated split) | ZIP Code v1 (test) |
| Metric | Average Performance |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 14 of 14 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Average Performance](<https://www.sota2.com/research/sota/aggregate-spatial-task-performance-on-zip-code-v1-test.md?metric=Average%20Performance>): Higher is better; unit: PERCENT.

- [R^2](<https://www.sota2.com/research/sota/aggregate-spatial-task-performance-on-zip-code-v1-test.md?metric=R%5E2>): Higher is better; unit: SCALAR.

## Recorded results

| Method | Average Performance | Result date | Report paper |
| --- | --- | --- | --- |
| UrbanFusion | 67.6 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| GeoCLIP | 65.3 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| PDFM | 55.3 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| GeoCLIP | 51.2 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| GPS2Vec | 46.8 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| SatCLIP L10 | 37.8 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| SatCLIP L10 | 36.4 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| CSP | 36.3 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| Identity | 35.1 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| CSP | 34.7 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| GAIR | 34.5 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| SatCLIP L40 | 29.6 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| GPS2Vec | 9.1 | Not recorded | 68fa7c2d1e209131cea8ce16 |
| SatCLIP L40 | 8.1 | Not recorded | 68fa7c2d1e209131cea8ce16 |

### UrbanFusion

Average Performance: 67.6. Result ID: 6a1e8b4cfbc373592c186bda.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

Recorded evaluation configuration: {"Pre-training Dataset":"PP2-M"}. This record does not assert independent reproduction.

### GeoCLIP

Average Performance: 65.3. Result ID: 6a1e8b4cfbc373592c186bdc.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa713c1e209131cea4ff8e.md>)

[Implementation](<https://vicentevivan.github.io/GeoCLIP>)

Recorded evaluation configuration: {"Pre-training Dataset":"PP2-M"}. This record does not assert independent reproduction.

### PDFM

Average Performance: 55.3. Result ID: 6a1e8b4cfbc373592c186be6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7b5e1e209131cea87f72.md>)

Recorded evaluation configuration: {"Pre-training Dataset":"Google"}. This record does not assert independent reproduction.

### GeoCLIP

Average Performance: 51.2. Result ID: 6a1e8b4cfbc373592c186bdf.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa713c1e209131cea4ff8e.md>)

[Implementation](<https://vicentevivan.github.io/GeoCLIP>)

Recorded evaluation configuration: {"Pre-training Dataset":"MP-16"}. This record does not assert independent reproduction.

### GPS2Vec

Average Performance: 46.8. Result ID: 6a1e8b4cfbc373592c186be2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

Recorded evaluation configuration: {"Modality":"tag"}. This record does not assert independent reproduction.

### SatCLIP L10

Average Performance: 37.8. Result ID: 6a1e8b4cfbc373592c186be0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72d91e209131cea58e49.md>)

Recorded evaluation configuration: {"Pre-training Dataset":"S2-100K"}. This record does not assert independent reproduction.

### SatCLIP L10

Average Performance: 36.4. Result ID: 6a1e8b4cfbc373592c186bdd.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72d91e209131cea58e49.md>)

Recorded evaluation configuration: {"Pre-training Dataset":"PP2-M"}. This record does not assert independent reproduction.

### CSP

Average Performance: 36.3. Result ID: 6a1e8b4cfbc373592c186be4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f421e209131cea44901.md>)

Recorded evaluation configuration: {"Pre-training Dataset":"FMoW"}. This record does not assert independent reproduction.

### Identity

Average Performance: 35.1. Result ID: 6a1e8b4cfbc373592c186be7.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

Recorded evaluation configuration: {"Type":"y ∼ g(c)"}. This record does not assert independent reproduction.

### CSP

Average Performance: 34.7. Result ID: 6a1e8b4cfbc373592c186be5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6f421e209131cea44901.md>)

Recorded evaluation configuration: {"Pre-training Dataset":"iNat"}. This record does not assert independent reproduction.

### GAIR

Average Performance: 34.5. Result ID: 6a1e8b4cfbc373592c186bdb.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa77951e209131cea7421a.md>)

Recorded evaluation configuration: {"Pre-training Dataset":"PP2-M"}. This record does not assert independent reproduction.

### SatCLIP L40

Average Performance: 29.6. Result ID: 6a1e8b4cfbc373592c186be1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72d91e209131cea58e49.md>)

Recorded evaluation configuration: {"Pre-training Dataset":"S2-100K"}. This record does not assert independent reproduction.

### GPS2Vec

Average Performance: 9.1. Result ID: 6a1e8b4cfbc373592c186be3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

Recorded evaluation configuration: {"Modality":"visual"}. This record does not assert independent reproduction.

### SatCLIP L40

Average Performance: 8.1. Result ID: 6a1e8b4cfbc373592c186bde.

[Reporting paper](<https://www.sota2.com/research/paper/68fa7c2d1e209131cea8ce16.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72d91e209131cea58e49.md>)

Recorded evaluation configuration: {"Pre-training Dataset":"PP2-M"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
