Autonomous Driving Policy Evaluation on NAVSIM navhard v2
99.6NCGuideFlow
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GuideFlowHuman Traj?=true, SimScale Data?=false, Stage=S12026.06 | 99.6 | 98 | 99.4 | 99.3 | 79.7 | 99.3 | 94.9 | 97.1 | 58.2 | — | — | |
| SimScaleHuman Traj?=true, SimScale Data?=true, Stage=S12026.06 | 99.6 | 99.1 | 99.9 | 100 | 69.6 | 99.6 | 95.8 | 95.6 | 28.4 | — | — | |
| Gigapixel-DrivoRHuman Traj?=false, SimScale Data?=false, Stage=S12026.06 | 99.4 | 95.8 | 99.4 | 99.8 | 68.1 | 99.6 | 91.8 | 97.6 | 49.8 | 77.8 | — | |
| DrivoR (w/ SimScale)Human Traj?=true, SimScale Data?=true, Stage=S12026.06 | 99.1 | 98.2 | 99.3 | 99.8 | 75.4 | 98.7 | 94.9 | 97.6 | 70.2 | 84.2 | — | |
| ZTRSHuman Traj?=false, SimScale Data?=false, Stage=S12026.06 | 98.9 | 97.6 | 100 | 100 | 66.7 | 98.9 | 96.2 | 96.7 | 44 | — | — | |
| DrivoRHuman Traj?=true, SimScale Data?=false, Stage=S12026.06 | 98.8 | 95.1 | 98.9 | 100 | 72.6 | 98.7 | 94 | 97.6 | 73.3 | 80.9 | — | |
| RAPHuman Traj?=true, SimScale Data?=false, Stage=S12026.06 | 97.1 | 94.4 | 98.8 | 99.8 | 83.9 | 96.9 | 94.7 | 96.4 | 66.2 | — | — | |
| LTFHuman Traj?=true, SimScale Data?=false, Stage=S12026.06 | 96.2 | 79.6 | 99.1 | 99.6 | 84.1 | 95.1 | 94.2 | 97.6 | 79.1 | — | — | |
| DrivoR-RegHuman Traj?=true, SimScale Data?=false, Stage=S12026.06 | 96.1 | 76.4 | 97.6 | 99.3 | 83.3 | 95.6 | 93.1 | 97.8 | 80.4 | 65.2 | — | |
| SimScaleHuman Traj?=true, SimScale Data?=true, Stage=S22026.06 | 94.5 | 94.2 | 95.8 | 99.2 | 75.8 | 92.8 | 60.1 | 96.1 | 43.2 | — | 53.2 | |
| Gigapixel-DrivoRHuman Traj?=false, SimScale Data?=false, Stage=S22026.06 | 93.7 | 92.9 | 96 | 98.9 | 62.6 | 90.7 | 60.2 | 98.2 | 58.8 | 63.5 | 50.1 | |
| DrivoR (w/ SimScale)Human Traj?=true, SimScale Data?=true, Stage=S22026.06 | 92.3 | 91.6 | 97.3 | 99.1 | 75.7 | 90.6 | 56.1 | 98.4 | 44.7 | 64.6 | 54.7 | |
| GuideFlowHuman Traj?=true, SimScale Data?=false, Stage=S22026.06 | 91.4 | 89.5 | 95.2 | 98.9 | 77.5 | 89.6 | 52.6 | 93.6 | 51 | — | 51.5 | |
| ZTRSHuman Traj?=false, SimScale Data?=false, Stage=S22026.06 | 91.1 | 90.4 | 95.8 | 99 | 63.6 | 89.8 | 60.4 | 97.6 | 66.1 | — | 48.1 | |
| Gigapixel-DrivoR-RegHuman Traj?=false, SimScale Data?=false, Stage=S12026.06 | 90.2 | 78.9 | 95.3 | 99.3 | 86.4 | 88.4 | 95.8 | 97.8 | 64.4 | 60.9 | — | |
| DrivoRHuman Traj?=true, SimScale Data?=false, Stage=S22026.06 | 90.2 | 88.4 | 91.9 | 98.6 | 70 | 88 | 50.1 | 98.5 | 76.2 | 59.4 | 48.3 | |
| RAPHuman Traj?=true, SimScale Data?=false, Stage=S22026.06 | 83.2 | 83.9 | 87.4 | 98 | 86.9 | 80.4 | 52.3 | 95.2 | 52.4 | — | 39.6 | |
| Gigapixel-DrivoR-RegHuman Traj?=false, SimScale Data?=false, Stage=S22026.06 | 80.4 | 77.4 | 86.7 | 96.8 | 91.4 | 77.6 | 57.7 | 97.4 | 52.1 | 45.5 | 29.5 | |
| DrivoR-RegHuman Traj?=true, SimScale Data?=false, Stage=S22026.06 | 79 | 68.5 | 82.2 | 98.7 | 83.4 | 76.9 | 44 | 95.9 | 77.6 | 38.4 | 25.5 | |
| LTFHuman Traj?=true, SimScale Data?=false, Stage=S22026.06 | 77.8 | 70.2 | 84.3 | 98.1 | 85.1 | 75.7 | 45.4 | 95.7 | 76 | — | 25.1 |