Autonomous Driving on LaMPilot-Bench
0Collision RateIDM
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| IDMLearning=N/A2024.10 | 0 | 20.4 | 92.8 | 80.9 | 71 | 17.3 | |
| MOBILLearning=N/A2024.10 | 0 | 15.3 | 82.8 | 85.9 | 46.7 | 11.7 | |
| Human DriverLearning=N/A2024.10 | 0 | 98 | 93.4 | 86.3 | 81.3 | 84.6 | |
| Llama 2Learning=0-Shot2024.10 | 0 | 20.4 | 92.8 | 81.4 | 68.9 | 17.3 | |
| PaLM 2Learning=Human Feedback2024.10 | 0 | 45.5 | 81.1 | 74.4 | 77.6 | 35.6 | |
| Llama 2Learning=Human Feedback2024.10 | 0.9 | 32.7 | 83.9 | 74.6 | 74.6 | 21.4 | |
| ChatGPTLearning=Human Feedback2024.10 | 0.9 | 80.9 | 70.2 | 71.7 | 77.5 | 54.2 | |
| GPT-4Learning=Human Feedback2024.10 | 0.9 | 92.7 | 67.6 | 72.2 | 76.8 | 64 | |
| GPT-4 TurboLearning=Human Feedback2024.10 | 0.9 | 87.3 | 74.1 | 73.4 | 75.5 | 60.5 | |
| ChatGPTLearning=0-Shot2024.10 | 1 | 40.8 | 83.9 | 75.5 | 74 | 27.8 | |
| Llama 2Learning=3-Shot2024.10 | 1 | 63.3 | 68.3 | 71.4 | 73.8 | 39.6 | |
| GPT-4Learning=3-Shot2024.10 | 1 | 84.7 | 69.4 | 72 | 76.7 | 55.9 | |
| GPT-4 TurboLearning=3-Shot2024.10 | 1 | 80.6 | 69.1 | 71.5 | 74.9 | 52.6 | |
| PaLM 2Learning=0-Shot2024.10 | 3.1 | 35.7 | 78.6 | 76.5 | 78.8 | 12.8 | |
| GPT-4 TurboLearning=0-Shot2024.10 | 3.1 | 74.5 | 73.2 | 70.1 | 73.9 | 39.1 | |
| PaLM 2Learning=3-Shot2024.10 | 3.1 | 71.4 | 73.4 | 69.7 | 72 | 36.6 | |
| GPT-4Learning=0-Shot2024.10 | 4.1 | 72.4 | 61.3 | 70.5 | 74 | 28.5 | |
| ChatGPTLearning=3-Shot2024.10 | 4.1 | 83.7 | 70.9 | 73.7 | 77.7 | 41.2 |