Overall Driving Performance on GEODRIVE-BENCH (cross-country standard deviation)
3.47Std Dev of Overall AccuracyQwen2.5-VL-7B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2.5-VL-7BSetting=Rule-Given2026.06 | 3.47 | |
| DriveOPD‡Setting=Reasoning, backbone=InternVL3-8B2026.06 | 3.76 | |
| InternVL3-8BSetting=Rule-Given2026.06 | 4.04 | |
| DriveOPD†Setting=Direct, backbone=Qwen2.5-VL-7B2026.06 | 4.48 | |
| DriveOPD‡Setting=Rule-Given, backbone=InternVL3-8B2026.06 | 4.58 | |
| DriveOPD‡Setting=Direct, backbone=InternVL3-8B2026.06 | 4.89 | |
| Qwen3-VL-8BSetting=Rule-Given2026.06 | 4.98 | |
| DriveOPD†Setting=Reasoning, backbone=Qwen2.5-VL-7B2026.06 | 5.14 | |
| DriveOPD†Setting=Rule-Given, backbone=Qwen2.5-VL-7B2026.06 | 5.56 | |
| Llama-3.2-11B-VSetting=Rule-Given2026.06 | 5.73 | |
| InternVL3.5-8BSetting=Rule-Given2026.06 | 5.82 | |
| LLaVA-1.6-7BSetting=Rule-Given2026.06 | 6.13 | |
| Gemma3-12BSetting=Rule-Given2026.06 | 6.9 | |
| Gemma3-12BSetting=Direct2026.06 | 7.79 | |
| InternVL3.5-8BSetting=Direct2026.06 | 8.68 | |
| Qwen3-VL-8BSetting=Reasoning2026.06 | 9.87 | |
| Gemma3-12BSetting=Reasoning2026.06 | 10.15 | |
| LLaVA-1.6-7BSetting=Direct2026.06 | 10.41 | |
| LLaVA-1.6-7BSetting=Reasoning2026.06 | 10.48 | |
| InternVL3-8BSetting=Direct2026.06 | 10.85 | |
| InternVL3.5-8BSetting=Reasoning2026.06 | 10.87 | |
| Llama-3.2-11B-VSetting=Direct2026.06 | 10.91 | |
| InternVL3-8BSetting=Reasoning2026.06 | 11.4 | |
| Qwen3-VL-8BSetting=Direct2026.06 | 11.45 | |
| Qwen2.5-VL-7BSetting=Reasoning2026.06 | 11.48 | |
| Llama-3.2-11B-VSetting=Reasoning2026.06 | 11.5 | |
| Qwen2.5-VL-7BSetting=Direct2026.06 | 12.03 |