Planning Evaluation on NAVSIM navhard v2
99.8NCDriveFuture
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| DriveFutureBackbone=V2-99, Stage=Stage 12026.05 | 99.8 | 99.8 | 100 | 99.6 | 85.7 | 99.8 | 98.7 | 97.6 | 66.2 | 55.5 | |
| SimScaleBackbone=V2-99, Stage=Stage 12026.05 | 99.6 | 99.1 | 99.9 | 100 | 69.6 | 99.6 | 95.8 | 95.6 | 28.4 | 53.2 | |
| DrivoRBackbone=ViT-S, Stage=Stage 12026.05 | 99.1 | 98.2 | 99.3 | 99.8 | 75.4 | 98.7 | 94.9 | 97.6 | 70.2 | 54.6 | |
| DriveSuprimBackbone=V2-99, Stage=Stage 12026.05 | 98.9 | 95.1 | 99.2 | 99.6 | 76.1 | 99.1 | 94.7 | 97.6 | 54.2 | 42.1 | |
| ZTRSBackbone=V2-99, Stage=Stage 12026.05 | 98.9 | 97.6 | 100 | 100 | 66.7 | 98.9 | 96.2 | 96.7 | 44 | 48.1 | |
| GTRS-EBackbone=V2-99+EVA-ViT-L+ViT-L, Stage=Stage 12026.05 | 98.9 | 99.3 | 99.8 | 99.8 | 75.2 | 98.4 | 96 | 97.6 | 51.6 | 49.4 | |
| SpanVLABackbone=Qwen2.5-VL-3B, Stage=Stage 12026.05 | 98.4 | 94.3 | 97.8 | 99.9 | 85.7 | 97.2 | 94.2 | 97.6 | 72.1 | 40.1 | |
| World4DriveBackbone=ResNet-34, Stage=Stage 12026.05 | 97.3 | 89.1 | 97.6 | 99.7 | 60.5 | 96.8 | 87.7 | 93.1 | 60 | 34.9 | |
| GuideFlowBackbone=ResNet-34, Stage=Stage 12026.05 | 96.6 | 80.5 | 96.3 | 99.3 | 82.3 | 94.9 | 91.5 | 97.7 | 67.8 | 27.1 | |
| TransFuserBackbone=ResNet-34, Stage=Stage 12026.05 | 96.2 | 79.5 | 99.1 | 99.5 | 84.1 | 95.1 | 94.2 | 97.5 | 79.1 | 23.1 | |
| MindDriveBackbone=ResNet-34, Stage=Stage 12026.05 | 96.1 | 86 | 98.8 | 99.3 | 83.3 | 95.6 | 94.4 | 97.6 | 74.7 | 30.9 | |
| DiffusionDriveBackbone=ResNet-34, Stage=Stage 12026.05 | 96 | 79.7 | 97.4 | 99.5 | 81.3 | 93.1 | 90.8 | 96.8 | 73.8 | 24.2 | |
| DiffVLABackbone=V2-99 + ViT-L/14, Stage=Stage 12026.05 | 95.7 | 99.2 | 100 | 100 | 85.9 | 96.4 | 97.1 | 95 | 84.2 | 45 | |
| Senna-E2EBackbone=ResNet-50, Stage=Stage 12026.05 | 95.6 | 86 | 98.9 | 99.6 | 83.9 | 95.1 | 95.3 | 97.6 | 75.6 | 27.2 | |
| SimScaleBackbone=V2-99, Stage=Stage 22026.05 | 94.5 | 94.2 | 95.8 | 99.2 | 75.8 | 92.8 | 60.1 | 96.1 | 43.2 | — | |
| GTRS-EBackbone=V2-99+EVA-ViT-L+ViT-L, Stage=Stage 22026.05 | 92.3 | 93.3 | 94.6 | 99.2 | 73.1 | 91.2 | 53.9 | 96.7 | 56.8 | — | |
| DrivoRBackbone=ViT-S, Stage=Stage 22026.05 | 92.3 | 91.6 | 97.3 | 99.1 | 75.7 | 90.6 | 56.1 | 98.4 | 44.7 | — | |
| World4DriveBackbone=ResNet-34, Stage=Stage 22026.05 | 91.4 | 82 | 91 | 98.5 | 53.1 | 90.6 | 52.3 | 93.3 | 62.8 | — | |
| ZTRSBackbone=V2-99, Stage=Stage 22026.05 | 91.1 | 90.4 | 95.8 | 99 | 63.6 | 89.8 | 60.4 | 97.6 | 66.1 | — | |
| DriveFutureBackbone=V2-99, Stage=Stage 22026.05 | 90.6 | 87.5 | 94.1 | 99.1 | 84.6 | 88.8 | 58.3 | 93.5 | 45.6 | — | |
| DriveSuprimBackbone=V2-99, Stage=Stage 22026.05 | 87.9 | 88.8 | 89.6 | 98.8 | 80.3 | 86 | 53.5 | 97.1 | 56.1 | — | |
| GuideFlowBackbone=ResNet-34, Stage=Stage 22026.05 | 87.3 | 76.7 | 88.8 | 99.2 | 84.3 | 85.1 | 49.7 | 93.1 | 44.5 | — | |
| SpanVLABackbone=Qwen2.5-VL-3B, Stage=Stage 22026.05 | 86.9 | 84.3 | 87.1 | 98.2 | 85.5 | 82.7 | 62.3 | 96.8 | 67.4 | — | |
| MindDriveBackbone=ResNet-34, Stage=Stage 22026.05 | 82.6 | 79.1 | 86.4 | 98 | 85.3 | 79.4 | 49.2 | 96.5 | 71 | — | |
| DiffusionDriveBackbone=ResNet-34, Stage=Stage 22026.05 | 82.1 | 72.2 | 88.5 | 98.7 | 85.1 | 78.8 | 49.2 | 89.3 | 71.2 | — | |
| DiffVLABackbone=V2-99 + ViT-L/14, Stage=Stage 22026.05 | 81.2 | 88.8 | 94.6 | 99 | 86 | 76.4 | 59.8 | 98.6 | 80.4 | — | |
| Senna-E2EBackbone=ResNet-50, Stage=Stage 22026.05 | 78.6 | 74.8 | 84.8 | 98.2 | 88.2 | 75.7 | 46.9 | 96 | 65.8 | — | |
| TransFuserBackbone=ResNet-34, Stage=Stage 22026.05 | 77.7 | 70.2 | 84.2 | 98 | 85.1 | 75.6 | 45.4 | 95.7 | 75.9 | — |