Autonomous Driving Reasoning on DriveLMM-o1
82.31Risk AssessmentOmniDrive-R1
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| OmniDrive-R1reasoning_strategy=Multi-modal Interleaved Chain-of-Thought2025.12 | 82.31 | 85.42 | 83.75 | 82.58 | 78.26 | 80.35 | 73.62 | — | — | — | — | — | |
| OmniDrive-R12026.07 | 82.31 | 85.42 | 83.75 | 82.58 | 78.26 | 80.35 | 73.62 | — | — | — | — | — | |
| CritiqueDriveVLM-TeacherStage=22026.07 | 81.63 | 86.21 | 82.27 | 85.46 | 79.17 | 80.48 | 76.54 | — | — | — | — | — | |
| Agentthink2025.12 | 80.51 | 84.98 | 82.11 | 84.99 | 79.56 | 79.68 | 71.35 | — | — | — | — | — | |
| AgentThink2026.07 | 80.51 | 84.98 | 82.11 | 84.99 | 79.56 | 79.68 | 71.35 | — | — | — | — | — | |
| Qwen3-VLParameters=8B2026.07 | 79.5 | 84.32 | 80.41 | 84.43 | 75.32 | 77.76 | 55.54 | — | — | — | — | — | |
| DriveLMM-o1Tokens retained per image=256, Retention percentage=100%2026.06 | 73.81 | 82.26 | 75.64 | 79.51 | 71.38 | 74.37 | — | — | — | — | — | — | |
| DriveLMM-o12025.12 | 73.01 | 81.56 | 75.39 | 79.42 | 74.49 | 75.24 | 62.36 | — | — | — | — | — | |
| DriveLMM-o12026.07 | 73.01 | 81.56 | 75.39 | 79.42 | 74.49 | 75.24 | 62.36 | — | — | — | — | — | |
| MVPrunerTokens retained per image=64, Retention percentage=25%2026.06 | 72.91 | 81.96 | 74.85 | 78.55 | 71.58 | 73.79 | — | — | — | — | — | — | |
| MVPrunerTokens retained per image=25, Retention percentage=10%2026.06 | 72.05 | 81.81 | 73.8 | 77.61 | 70.25 | 72.91 | — | — | — | — | — | — | |
| DivPruneTokens retained per image=64, Retention percentage=25%, Venue=CVPR252026.06 | 71.66 | 78.39 | 73.04 | 77.45 | 69.92 | 71.67 | — | — | — | — | — | — | |
| DARTTokens retained per image=64, Retention percentage=25%, Venue=EMNLP252026.06 | 71.5 | 78.21 | 72.8 | 77.33 | 69.63 | 71.46 | — | — | — | — | — | — | |
| FastVTokens retained per image=64, Retention percentage=25%, Venue=ECCV242026.06 | 71.35 | 80.58 | 72.85 | 76.74 | 69.25 | 72.41 | — | — | — | — | — | — | |
| GPT-4o2025.12 | 71.32 | 80.72 | 72.96 | 76.65 | 71.43 | 72.52 | 57.84 | — | — | — | — | — | |
| GPT-4o2026.07 | 71.32 | 80.72 | 72.96 | 76.65 | 71.43 | 72.52 | 57.84 | — | — | — | — | — | |
| Prune2DriveTokens retained per image=64, Retention percentage=25%, Venue=CVPR262026.06 | 71.31 | 80.74 | 73.07 | 77.48 | 69.3 | 72.69 | — | — | — | — | — | — | |
| PACTTokens retained per image=64, Retention percentage=25%, Venue=CVPR252026.06 | 71.2 | 78.11 | 71.44 | 77.21 | 68.95 | 70.95 | — | — | — | — | — | — | |
| Prune2DriveTokens retained per image=25, Retention percentage=10%, Venue=CVPR262026.06 | 70.76 | 77.66 | 72.29 | 77.01 | 68.94 | 70.31 | — | — | — | — | — | — | |
| SparseVLMTokens retained per image=64, Retention percentage=25%, Venue=ICML252026.06 | 70.08 | 79.59 | 71.87 | 75.66 | 67.43 | 71.23 | — | — | — | — | — | — | |
| DivPruneTokens retained per image=25, Retention percentage=10%, Venue=CVPR252026.06 | 69.32 | 76.47 | 70.78 | 75.53 | 68.22 | 69.65 | — | — | — | — | — | — | |
| InternVL2.5-8BParameters=8B2025.12 | 69.02 | 78.43 | 71.52 | 75.8 | 70.54 | 71.62 | 54.87 | — | — | — | — | — | |
| InternVL2.5Parameters=8B2026.07 | 69.02 | 78.43 | 71.52 | 75.8 | 70.54 | 71.62 | 54.87 | — | — | — | — | — | |
| DARTTokens retained per image=25, Retention percentage=10%, Venue=EMNLP252026.06 | 68.6 | 75.81 | 69.97 | 74.94 | 67.6 | 69.01 | — | — | — | — | — | — | |
| PACTTokens retained per image=25, Retention percentage=10%, Venue=CVPR252026.06 | 68.2 | 76.23 | 69.11 | 74.14 | 66.1 | 68.38 | — | — | — | — | — | — | |
| SparseVLMTokens retained per image=25, Retention percentage=10%, Venue=ICML252026.06 | 68.18 | 77.81 | 69.87 | 73.98 | 66.2 | 69.4 | — | — | — | — | — | — | |
| FastVTokens retained per image=25, Retention percentage=10%, Venue=ECCV242026.06 | 67.74 | 78.07 | 69.37 | 73.24 | 66.02 | 69.56 | — | — | — | — | — | — | |
| Qwen2.5VL-72BParameters=72B2025.12 | 64.4 | 72.81 | 60.29 | 65.13 | 62.81 | 65.73 | 61.27 | — | — | — | — | — | |
| Qwen2.5-VLParameters=72B2026.07 | 64.4 | 72.81 | 60.29 | 65.13 | 62.81 | 65.73 | 61.27 | — | — | — | — | — | |
| LlamaV-O12025.12 | 60.2 | 73.52 | 62.67 | 64.66 | 63.41 | 63.13 | 50.02 | — | — | — | — | — | |
| LlamaV-O12026.07 | 60.2 | 73.52 | 62.67 | 64.66 | 63.41 | 63.13 | 50.02 | — | — | — | — | — | |
| LLaVA-CoT2025.12 | 57.62 | 69.01 | 60.84 | 62.72 | 60.67 | 61.41 | 49.27 | — | — | — | — | — | |
| LLaVA-CoT2026.07 | 57.62 | 69.01 | 60.84 | 62.72 | 60.67 | 61.41 | 49.27 | — | — | — | — | — | |
| DriveLMM-o1LMM=Qwen2.5-VL2026.03 | 53.08 | 68.52 | 49.91 | — | — | 56.63 | 51.14 | 47.43 | 50.96 | 51.7 | — | — | |
| RailVQA-CoMLMM=DriveLMM-o1(Qwen2.5-VL)2026.03 | 52.88 | 68.07 | 56.48 | — | — | 58.89 | 54.57 | 48.66 | 52.81 | 53.77 | — | — | |
| DriveLMM-o1LMM=InternVL-2.52026.03 | 52.55 | 67.22 | 54.67 | — | — | 57.48 | 54.11 | 49.84 | 51.2 | 51.69 | — | — | |
| Mulberry-7BParameters=7B2025.12 | 51.89 | 63.66 | 56.68 | 57.27 | 57.45 | 57.65 | 52.86 | — | — | — | — | — | |
| MulberryParameters=7B2026.07 | 51.89 | 63.66 | 56.68 | 57.27 | 57.45 | 57.65 | 52.86 | — | — | — | — | — | |
| Ovis1.5-Gemma2-9BParameters=9B2025.12 | 51.34 | 66.36 | 54.74 | 55.72 | 55.74 | 55.62 | 48.85 | — | — | — | — | — | |
| Ovis1.5-Gemma2Parameters=9B2026.07 | 51.34 | 66.36 | 54.74 | 55.72 | 55.74 | 55.62 | 48.85 | — | — | — | — | — | |
| Qwen2.5VL-7BParameters=7B2025.12 | 46.44 | 60.45 | 51.02 | 50.15 | 52.19 | 51.77 | 37.81 | — | — | — | — | — | |
| Qwen2.5-VLParameters=7B2026.07 | 46.44 | 60.45 | 51.02 | 50.15 | 52.19 | 51.77 | 37.81 | — | — | — | — | — | |
| Cosmos-R1Category=Embodied Models2026.04 | — | — | — | — | — | — | — | — | — | — | 54.66 | — | |
| DriveLMM-o1Prefilling Latency (ms)=591, Decoding Latency (ms)=51.9, FLOPs=100%, GPU Peak Memory (GB)=17.31, Throughput (samples/s)=11.84, Pruning Setting=None2026.06 | — | — | — | — | — | — | — | — | — | — | — | 74.37 | |
| DriveMMCategory=Embodied Models2026.04 | — | — | — | — | — | — | — | — | — | — | 65.91 | — | |
| FastVPrefilling Speedup (ms)=128.5(↑4.60×), Decoding Speedup (ms)=45.9(↑1.13×), FLOPs=20.3%, GPU Peak Memory (GB)=16.61, Throughput (samples/s)=10.57(↑1.12×), Pruning Setting=90%2026.06 | — | — | — | — | — | — | — | — | — | — | — | 69.56 | |
| GPT-4oCategory=Proprietary Models2026.04 | — | — | — | — | — | — | — | — | — | — | 57.84 | — | |
| Mimo-EmbodiedCategory=Embodied Models2026.04 | — | — | — | — | — | — | — | — | — | — | 40.31 | — | |
| MVPrunerPrefilling Speedup (ms)=155.5(↑3.80×), Decoding Speedup (ms)=42.2(↑1.23×), FLOPs=20.0%, GPU Peak Memory (GB)=16.08, Throughput (samples/s)=8.60(↑1.38×), Pruning Setting=90%2026.06 | — | — | — | — | — | — | — | — | — | — | — | 72.91 | |
| PR1-Counting-2BCategory=Spatial Models2026.04 | — | — | — | — | — | — | — | — | — | — | 50.94 | — | |
| PR1-Detection-3BCategory=Spatial Models2026.04 | — | — | — | — | — | — | — | — | — | — | 44.81 | — | |
| PR1-Grounding-2BCategory=Spatial Models2026.04 | — | — | — | — | — | — | — | — | — | — | 53.83 | — | |
| PR1-OCR-2BCategory=Spatial Models2026.04 | — | — | — | — | — | — | — | — | — | — | 47.68 | — | |
| Prune2DrivePrefilling Speedup (ms)=127.1(↑4.65×), Decoding Speedup (ms)=47.2(↑1.10×), FLOPs=20.3%, GPU Peak Memory (GB)=16.58, Throughput (samples/s)=8.58(↑1.38×), Pruning Setting=90%2026.06 | — | — | — | — | — | — | — | — | — | — | — | 70.31 | |
| Qwen2.5-VL-32BCategory=Open-Source Models2026.04 | — | — | — | — | — | — | — | — | — | — | 55.04 | — | |
| Qwen2.5-VL-7BCategory=Open-Source Models2026.04 | — | — | — | — | — | — | — | — | — | — | 37.81 | — | |
| Qwen3-VL-32BCategory=Open-Source Models2026.04 | — | — | — | — | — | — | — | — | — | — | 55.29 | — | |
| Qwen3-VL-A3B-30BCategory=Open-Source Models2026.04 | — | — | — | — | — | — | — | — | — | — | 57.17 | — | |
| SparseVLMPrefilling Speedup (ms)=164.6(↑3.59×), Decoding Speedup (ms)=47.6(↑1.09×), FLOPs=20.7%, GPU Peak Memory (GB)=16.65, Throughput (samples/s)=9.55(↑1.24×), Pruning Setting=90%2026.06 | — | — | — | — | — | — | — | — | — | — | — | 69.4 | |
| UniVG-R1-7BCategory=Spatial Models2026.04 | — | — | — | — | — | — | — | — | — | — | 51.42 | — | |
| XEmbodiedversion=Best2026.04 | — | — | — | — | — | — | — | — | — | — | 77.01 | — |