# Urban Delivery Optimization on Columbus

Source: [Urban Delivery Optimization on Columbus](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-07T07:36:32.602Z

Evaluation of urban delivery optimization strategies using the Columbus dataset, focusing on delivery completion rates, success rates, vehicle/package distances, and associated delivery times and delays.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Urban Delivery Optimization |
| Dataset (including any stated split) | Columbus |
| Metric | Completed Deliveries |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 6 of 6 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Completed Deliveries](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Completed%20Deliveries>): Higher is better; unit: SCALAR.

- [Successful Deliveries](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Successful%20Deliveries>): Higher is better; unit: SCALAR.

- [Failed Deliveries](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Failed%20Deliveries>): Lower is better; unit: SCALAR.

- [Success Rate](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Success%20Rate>): Higher is better; unit: PERCENT.

- [Completion Rate](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Completion%20Rate>): Higher is better; unit: PERCENT.

- [Vehicle Distance (km)](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Vehicle%20Distance%20(km)>): Lower is better; unit: SIZE.

- [Package Distance (km)](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Package%20Distance%20(km)>): Lower is better; unit: SIZE.

- [Distance Saved (km)](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Distance%20Saved%20(km)>): Higher is better; unit: SIZE.

- [Average Time (sec)](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Average%20Time%20(sec)>): Lower is better; unit: TIME.

- [Median Time (sec)](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Median%20Time%20(sec)>): Lower is better; unit: TIME.

- [Average Delay (sec)](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Average%20Delay%20(sec)>): Higher is better; unit: TIME.

- [Median Delay (sec)](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Median%20Delay%20(sec)>): Higher is better; unit: TIME.

- [Maximum Delay (sec)](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Maximum%20Delay%20(sec)>): Lower is better; unit: TIME.

- [Distance Saving (%)](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Distance%20Saving%20(%25)>): Higher is better; unit: PERCENT.

- [Bundles Created](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Bundles%20Created>): Higher is better; unit: SCALAR.

- [Bundling Participation Rate](<https://www.sota2.com/research/sota/urban-delivery-optimization-on-columbus.md?metric=Bundling%20Participation%20Rate>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Completed Deliveries | Result date | Report paper |
| --- | --- | --- | --- |
| MADDPG | 9234 | Not recorded | 69d48f977d0172140ec74327 |
| Attn-MADDPG | 9234 | Not recorded | 69d48f977d0172140ec74327 |
| UMST | 9103 | Not recorded | 69d48f977d0172140ec74327 |
| UMST | 9103 | Not recorded | 69d48f977d0172140ec74327 |
| MADDPG | 9 | Not recorded | 69d48f977d0172140ec74327 |
| GNN | 9 | Not recorded | 69d48f977d0172140ec74327 |

### MADDPG

Completed Deliveries: 9234. Result ID: 69d4b3ff47f34ce924bc2f58.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f977d0172140ec74327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa673a1e209131cea150a5.md>)

[Implementation](<https://github.com/openai/multiagent-particle-envs>)

Recorded evaluation configuration: {"Training Time (min)":"293.09"}. This record does not assert independent reproduction.

### Attn-MADDPG

Completed Deliveries: 9234. Result ID: 69d4b3ff47f34ce924bc2f59.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f977d0172140ec74327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa65dd1e209131cea0ced0.md>)

Recorded evaluation configuration: {"Training Time (min)":"983.34"}. This record does not assert independent reproduction.

### UMST

Completed Deliveries: 9103. Result ID: 69d4b3ff47f34ce924bc2f5a.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f977d0172140ec74327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48f977d0172140ec74327.md>)

Recorded evaluation configuration: {"Training Time (min)":"0.00"}. This record does not assert independent reproduction.

### UMST

Completed Deliveries: 9103. Result ID: 69d4b3ff47f34ce924bc2f5f.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f977d0172140ec74327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/69d48f977d0172140ec74327.md>)

Recorded evaluation configuration: {"Training Time (min)":"0"}. This record does not assert independent reproduction.

### MADDPG

Completed Deliveries: 9. Result ID: 69d4b3ff47f34ce924bc2f5e.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f977d0172140ec74327.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa673a1e209131cea150a5.md>)

[Implementation](<https://github.com/openai/multiagent-particle-envs>)

Recorded evaluation configuration: {"Training Time (min)":"293.09"}. This record does not assert independent reproduction.

### GNN

Completed Deliveries: 9. Result ID: 69d4b3ff47f34ce924bc2f60.

[Reporting paper](<https://www.sota2.com/research/paper/69d48f977d0172140ec74327.md>)

Recorded evaluation configuration: {"Training Time (min)":"29.41"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
