Trajectory Generation on CARLA FPV 1000 samples (test)
0.51ScoreQwen3-VL-4B (StyleVLA)
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Qwen3-VL-4B (StyleVLA)Model Category=Ours (StyleVLA), Evaluation Protocol=Fine-Tuned2026.03 | 0.51 | 38.6 | 36.9 | 1.17 | 3.13 | 0.11 | 2.13 | |
| Gemini 3 ProModel Category=Proprietary Models, Evaluation Protocol=Zero-Shot2026.03 | 0.35 | 17.65 | 62.35 | 1.54 | 3.94 | 0.06 | 91.39 | |
| Gemini 2.5 ProModel Category=Proprietary Models, Evaluation Protocol=Zero-Shot2026.03 | 0.29 | 16.63 | 70.74 | 2.23 | 5.76 | 0.06 | 35.48 | |
| GPT-5 NanoModel Category=Proprietary Models, Evaluation Protocol=Zero-Shot2026.03 | 0.29 | 16.67 | 69.7 | 2.36 | 6.06 | 0.11 | 49.05 | |
| Alpamayo-R1Model Category=SOTA Models, Model Scale=10B, Evaluation Protocol=Zero-Shot2026.03 | 0.19 | 13.6 | 73.1 | 3.37 | 5.85 | — | 0.65 | |
| OpenDriveVLAModel Category=SOTA Models, Model Scale=0.5B, Evaluation Protocol=Zero-Shot2026.03 | 0.13 | 7.38 | 87.25 | 5.83 | 9.82 | — | 0.51 | |
| Gemini 2.5 FlashModel Category=Proprietary Models, Evaluation Protocol=Zero-Shot2026.03 | 0.12 | 9.04 | 87.21 | 9.39 | 18.21 | 3.42 | 1.8 | |
| OrionModel Category=SOTA Models, Model Scale=7B, Evaluation Protocol=Zero-Shot2026.03 | 0.05 | 2.1 | 96.4 | 11.13 | 21.35 | — | 0.36 | |
| Qwen3-VL-4B (Base)Model Category=Open Source Baselines, Evaluation Protocol=Zero-Shot2026.03 | 0 | — | — | — | — | — | 4.97 | |
| SimLingoModel Category=SOTA Models, Model Scale=1B, Evaluation Protocol=Zero-Shot2026.03 | 0 | 0.3 | 99.4 | 8.01 | 17.58 | — | 0.55 |