# Overall Driving Performance on GEODRIVE-BENCH (cross-country standard deviation)

Source: [Overall Driving Performance on GEODRIVE-BENCH (cross-country standard deviation)](<https://www.sota2.com/research/sota/overall-driving-performance-on-geodrive-bench-cross-country-standard-deviation>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-06-04T07:08:15.047Z

Evaluation of overall driving performance metrics, specifically focusing on the standard deviation across different geographical regions within the GEODRIVE-BENCH dataset.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Overall Driving Performance |
| Dataset (including any stated split) | GEODRIVE-BENCH cross-country standard deviation |
| Metric | Std Dev of Overall Accuracy |
| Unit | PERCENT |
| Direction | Lower is better |
| Results loaded | 27 of 27 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Std Dev of Overall Accuracy](<https://www.sota2.com/research/sota/overall-driving-performance-on-geodrive-bench-cross-country-standard-deviation.md?metric=Std%20Dev%20of%20Overall%20Accuracy>): Lower is better; unit: PERCENT.

## Recorded results

| Method | Std Dev of Overall Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| Qwen2.5-VL-7B | 3.47 | Not recorded | 6a21067dc10484bac23f001b |
| DriveOPD‡ | 3.76 | Not recorded | 6a21067dc10484bac23f001b |
| InternVL3-8B | 4.04 | Not recorded | 6a21067dc10484bac23f001b |
| DriveOPD† | 4.48 | Not recorded | 6a21067dc10484bac23f001b |
| DriveOPD‡ | 4.58 | Not recorded | 6a21067dc10484bac23f001b |
| DriveOPD‡ | 4.89 | Not recorded | 6a21067dc10484bac23f001b |
| Qwen3-VL-8B | 4.98 | Not recorded | 6a21067dc10484bac23f001b |
| DriveOPD† | 5.14 | Not recorded | 6a21067dc10484bac23f001b |
| DriveOPD† | 5.56 | Not recorded | 6a21067dc10484bac23f001b |
| Llama-3.2-11B-V | 5.73 | Not recorded | 6a21067dc10484bac23f001b |
| InternVL3.5-8B | 5.82 | Not recorded | 6a21067dc10484bac23f001b |
| LLaVA-1.6-7B | 6.13 | Not recorded | 6a21067dc10484bac23f001b |
| Gemma3-12B | 6.9 | Not recorded | 6a21067dc10484bac23f001b |
| Gemma3-12B | 7.79 | Not recorded | 6a21067dc10484bac23f001b |
| InternVL3.5-8B | 8.68 | Not recorded | 6a21067dc10484bac23f001b |
| Qwen3-VL-8B | 9.87 | Not recorded | 6a21067dc10484bac23f001b |
| Gemma3-12B | 10.15 | Not recorded | 6a21067dc10484bac23f001b |
| LLaVA-1.6-7B | 10.41 | Not recorded | 6a21067dc10484bac23f001b |
| LLaVA-1.6-7B | 10.48 | Not recorded | 6a21067dc10484bac23f001b |
| InternVL3-8B | 10.85 | Not recorded | 6a21067dc10484bac23f001b |
| InternVL3.5-8B | 10.87 | Not recorded | 6a21067dc10484bac23f001b |
| Llama-3.2-11B-V | 10.91 | Not recorded | 6a21067dc10484bac23f001b |
| InternVL3-8B | 11.4 | Not recorded | 6a21067dc10484bac23f001b |
| Qwen3-VL-8B | 11.45 | Not recorded | 6a21067dc10484bac23f001b |
| Qwen2.5-VL-7B | 11.48 | Not recorded | 6a21067dc10484bac23f001b |
| Llama-3.2-11B-V | 11.5 | Not recorded | 6a21067dc10484bac23f001b |
| Qwen2.5-VL-7B | 12.03 | Not recorded | 6a21067dc10484bac23f001b |

### Qwen2.5-VL-7B

Std Dev of Overall Accuracy: 3.47. Result ID: 6a21244dfbc373592c1c2938.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Setting":"Rule-Given"}. This record does not assert independent reproduction.

### DriveOPD‡

Std Dev of Overall Accuracy: 3.76. Result ID: 6a21244dfbc373592c1c2943.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

Recorded evaluation configuration: {"Setting":"Reasoning","backbone":"InternVL3-8B"}. This record does not assert independent reproduction.

### InternVL3-8B

Std Dev of Overall Accuracy: 4.04. Result ID: 6a21244dfbc373592c1c2932.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76fa5.md>)

Recorded evaluation configuration: {"Setting":"Rule-Given"}. This record does not assert independent reproduction.

### DriveOPD†

Std Dev of Overall Accuracy: 4.48. Result ID: 6a21244dfbc373592c1c293f.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

Recorded evaluation configuration: {"Setting":"Direct","backbone":"Qwen2.5-VL-7B"}. This record does not assert independent reproduction.

### DriveOPD‡

Std Dev of Overall Accuracy: 4.58. Result ID: 6a21244dfbc373592c1c2944.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

Recorded evaluation configuration: {"Setting":"Rule-Given","backbone":"InternVL3-8B"}. This record does not assert independent reproduction.

### DriveOPD‡

Std Dev of Overall Accuracy: 4.89. Result ID: 6a21244dfbc373592c1c2942.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

Recorded evaluation configuration: {"Setting":"Direct","backbone":"InternVL3-8B"}. This record does not assert independent reproduction.

### Qwen3-VL-8B

Std Dev of Overall Accuracy: 4.98. Result ID: 6a21244dfbc373592c1c293b.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"Setting":"Rule-Given"}. This record does not assert independent reproduction.

### DriveOPD†

Std Dev of Overall Accuracy: 5.14. Result ID: 6a21244dfbc373592c1c2940.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

Recorded evaluation configuration: {"Setting":"Reasoning","backbone":"Qwen2.5-VL-7B"}. This record does not assert independent reproduction.

### DriveOPD†

Std Dev of Overall Accuracy: 5.56. Result ID: 6a21244dfbc373592c1c2941.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

Recorded evaluation configuration: {"Setting":"Rule-Given","backbone":"Qwen2.5-VL-7B"}. This record does not assert independent reproduction.

### Llama-3.2-11B-V

Std Dev of Overall Accuracy: 5.73. Result ID: 6a21244dfbc373592c1c293e.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"Setting":"Rule-Given"}. This record does not assert independent reproduction.

### InternVL3.5-8B

Std Dev of Overall Accuracy: 5.82. Result ID: 6a21244dfbc373592c1c2935.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7af01e209131cea85dc9.md>)

Recorded evaluation configuration: {"Setting":"Rule-Given"}. This record does not assert independent reproduction.

### LLaVA-1.6-7B

Std Dev of Overall Accuracy: 6.13. Result ID: 6a21244dfbc373592c1c292c.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

Recorded evaluation configuration: {"Setting":"Rule-Given"}. This record does not assert independent reproduction.

### Gemma3-12B

Std Dev of Overall Accuracy: 6.9. Result ID: 6a21244dfbc373592c1c292f.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa779f1e209131cea746cd.md>)

Recorded evaluation configuration: {"Setting":"Rule-Given"}. This record does not assert independent reproduction.

### Gemma3-12B

Std Dev of Overall Accuracy: 7.79. Result ID: 6a21244dfbc373592c1c292d.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa779f1e209131cea746cd.md>)

Recorded evaluation configuration: {"Setting":"Direct"}. This record does not assert independent reproduction.

### InternVL3.5-8B

Std Dev of Overall Accuracy: 8.68. Result ID: 6a21244dfbc373592c1c2933.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7af01e209131cea85dc9.md>)

Recorded evaluation configuration: {"Setting":"Direct"}. This record does not assert independent reproduction.

### Qwen3-VL-8B

Std Dev of Overall Accuracy: 9.87. Result ID: 6a21244dfbc373592c1c293a.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"Setting":"Reasoning"}. This record does not assert independent reproduction.

### Gemma3-12B

Std Dev of Overall Accuracy: 10.15. Result ID: 6a21244dfbc373592c1c292e.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa779f1e209131cea746cd.md>)

Recorded evaluation configuration: {"Setting":"Reasoning"}. This record does not assert independent reproduction.

### LLaVA-1.6-7B

Std Dev of Overall Accuracy: 10.41. Result ID: 6a21244dfbc373592c1c292a.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

Recorded evaluation configuration: {"Setting":"Direct"}. This record does not assert independent reproduction.

### LLaVA-1.6-7B

Std Dev of Overall Accuracy: 10.48. Result ID: 6a21244dfbc373592c1c292b.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

Recorded evaluation configuration: {"Setting":"Reasoning"}. This record does not assert independent reproduction.

### InternVL3-8B

Std Dev of Overall Accuracy: 10.85. Result ID: 6a21244dfbc373592c1c2930.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76fa5.md>)

Recorded evaluation configuration: {"Setting":"Direct"}. This record does not assert independent reproduction.

### InternVL3.5-8B

Std Dev of Overall Accuracy: 10.87. Result ID: 6a21244dfbc373592c1c2934.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7af01e209131cea85dc9.md>)

Recorded evaluation configuration: {"Setting":"Reasoning"}. This record does not assert independent reproduction.

### Llama-3.2-11B-V

Std Dev of Overall Accuracy: 10.91. Result ID: 6a21244dfbc373592c1c293c.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"Setting":"Direct"}. This record does not assert independent reproduction.

### InternVL3-8B

Std Dev of Overall Accuracy: 11.4. Result ID: 6a21244dfbc373592c1c2931.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa78241e209131cea76fa5.md>)

Recorded evaluation configuration: {"Setting":"Reasoning"}. This record does not assert independent reproduction.

### Qwen3-VL-8B

Std Dev of Overall Accuracy: 11.45. Result ID: 6a21244dfbc373592c1c2939.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6927db54d6b0dd3342930f66.md>)

Recorded evaluation configuration: {"Setting":"Direct"}. This record does not assert independent reproduction.

### Qwen2.5-VL-7B

Std Dev of Overall Accuracy: 11.48. Result ID: 6a21244dfbc373592c1c2937.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Setting":"Reasoning"}. This record does not assert independent reproduction.

### Llama-3.2-11B-V

Std Dev of Overall Accuracy: 11.5. Result ID: 6a21244dfbc373592c1c293d.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75d11e209131cea6a028.md>)

[Implementation](<https://github.com/meta-llama/llama-agentic-system>)

Recorded evaluation configuration: {"Setting":"Reasoning"}. This record does not assert independent reproduction.

### Qwen2.5-VL-7B

Std Dev of Overall Accuracy: 12.03. Result ID: 6a21244dfbc373592c1c2936.

[Reporting paper](<https://www.sota2.com/research/paper/6a21067dc10484bac23f001b.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa773a1e209131cea71d3c.md>)

Recorded evaluation configuration: {"Setting":"Direct"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
