Multimodal Autonomous Driving Capability on DriveBench
45.63Perception AccuracyQwen2.5-VL-3B-Instruct (Multi)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5-VL-3B-Instruct (Multi)Memory (GB)=8.5, Speed (tok/s)=28, 1st-token (s)=0.68, Distillation=Multi-Teacher Drive-KD2026.01 | 45.63 | 36.41 | 54.07 | 45.37 | |
| Qwen2.5-VL-3B-Instruct (Single)Memory (GB)=8.5, Speed (tok/s)=28, 1st-token (s)=0.68, Distillation=Single-Teacher Drive-KD2026.01 | 45.59 | 34.47 | 51.97 | 44.01 | |
| GPT-5.12026.01 | 45.56 | 41.02 | 51.94 | 46.17 | |
| InternVL3-1B (Multi)Memory (GB)=4.1, Speed (tok/s)=45.7, 1st-token (s)=0.45, Distillation=Multi-Teacher Drive-KD2026.01 | 43.5 | 33.15 | 55.51 | 44.05 | |
| InternVL3-1B (Single)Memory (GB)=4.1, Speed (tok/s)=45.7, 1st-token (s)=0.45, Distillation=Single-Teacher Drive-KD2026.01 | 43.13 | 34.32 | 52.97 | 43.47 | |
| InternVL3-78BMemory (GB)=171.6, Speed (tok/s)=4, 1st-token (s)=16.462026.01 | 42.01 | 47.16 | 36.31 | 41.83 | |
| InternVL3-8BMemory (GB)=18.3, Speed (tok/s)=32.6, 1st-token (s)=1.582026.01 | 40.05 | 41.15 | 32.77 | 37.99 | |
| InternVL3-14BMemory (GB)=33.4, Speed (tok/s)=17, 1st-token (s)=3.012026.01 | 39.83 | 40.84 | 36.35 | 39.01 | |
| Qwen2.5-VL-32B-InstructMemory (GB)=69.5, Speed (tok/s)=10.8, 1st-token (s)=2.362026.01 | 38.41 | 41.3 | 34.29 | 38 | |
| InternVL3-2BMemory (GB)=6.3, Speed (tok/s)=39.9, 1st-token (s)=0.672026.01 | 37.71 | 35.99 | 26.19 | 33.3 | |
| Qwen2.5-VL-7B-InstructMemory (GB)=17.1, Speed (tok/s)=32, 1st-token (s)=0.872026.01 | 36.26 | 37.54 | 32.84 | 35.55 | |
| Qwen2.5-VL-3B-InstructMemory (GB)=8.5, Speed (tok/s)=28, 1st-token (s)=0.682026.01 | 35.46 | 30.81 | 25.29 | 30.52 | |
| InternVL3-38BMemory (GB)=87, Speed (tok/s)=7.3, 1st-token (s)=9.842026.01 | 34.27 | 38.48 | 40.65 | 37.8 | |
| InternVL3-1BMemory (GB)=4.1, Speed (tok/s)=45.7, 1st-token (s)=0.452026.01 | 33.26 | 20.96 | 22.36 | 25.53 | |
| Llama-3.2-11B-Vision-InstructMemory (GB)=26.2, Speed (tok/s)=16.8, 1st-token (s)=1.552026.01 | 31.59 | 32.91 | 29.34 | 31.28 | |
| Llama-3.2-90B-Vision-InstructMemory (GB)=183.6, Speed (tok/s)=2.7, 1st-token (s)=8.052026.01 | 27.26 | 26.33 | 27.72 | 27.1 | |
| Qwen2.5-VL-72B-InstructMemory (GB)=146.5, Speed (tok/s)=5.8, 1st-token (s)=4.262026.01 | 23.78 | 27.67 | 50.76 | 34.07 |