Autonomous Driving on Agent-Driver
92.7Accuracy (ACC)Non-attack
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Non-attackAgent Backbone=ChatGPT, Retriever Type=end-to-end-retriever2024.07 | 92.7 | — | — | — | |
| BadChainAgent Backbone=ChatGPT, Retriever Type=end-to-end-retriever2024.07 | 92.3 | 35.6 | 53.9 | 38.4 | |
| AGENTPOISONAgent Backbone=ChatGPT, Retriever Type=end-to-end-retriever2024.07 | 92 | 84.4 | 64.9 | 59.6 | |
| Non-attackAgent Backbone=ChatGPT, Retriever Type=contrastive-retriever2024.07 | 91.6 | — | — | — | |
| GCGAgent Backbone=ChatGPT, Retriever Type=end-to-end-retriever2024.07 | 91.6 | 32.1 | 60 | 37.3 | |
| AGENTPOISONAgent Backbone=ChatGPT, Retriever Type=contrastive-retriever2024.07 | 91.1 | 80 | 68.5 | 56.8 | |
| GCGAgent Backbone=ChatGPT, Retriever Type=contrastive-retriever2024.07 | 91 | 18.5 | 76.1 | 37.8 | |
| AutoDANAgent Backbone=ChatGPT, Retriever Type=end-to-end-retriever2024.07 | 90.7 | 65.8 | 57.7 | 47.6 | |
| BadChainAgent Backbone=ChatGPT, Retriever Type=contrastive-retriever2024.07 | 90.4 | 43.2 | 64.7 | 44 | |
| AutoDANAgent Backbone=ChatGPT, Retriever Type=contrastive-retriever2024.07 | 89.4 | 57.6 | 67.2 | 53.6 | |
| CPAAgent Backbone=ChatGPT, Retriever Type=end-to-end-retriever2024.07 | 87.5 | 73.6 | 48.5 | 50.6 | |
| CPAAgent Backbone=ChatGPT, Retriever Type=contrastive-retriever2024.07 | 86.8 | 55.8 | 62.5 | 48.7 | |
| AGENTPOISONAgent Backbone=LLaMA3, Retriever Type=contrastive-retriever2024.07 | 84 | 78 | 94.7 | 54.7 | |
| Non-attackAgent Backbone=LLaMA3, Retriever Type=contrastive-retriever2024.07 | 83.6 | — | — | — | |
| AutoDANAgent Backbone=LLaMA3, Retriever Type=contrastive-retriever2024.07 | 83 | 54.2 | 92.9 | 49.8 | |
| Non-attackAgent Backbone=LLaMA3, Retriever Type=end-to-end-retriever2024.07 | 83 | — | — | — | |
| GCGAgent Backbone=LLaMA3, Retriever Type=contrastive-retriever2024.07 | 82.4 | 12.5 | 90.3 | 42.5 | |
| AGENTPOISONAgent Backbone=LLaMA3, Retriever Type=end-to-end-retriever2024.07 | 82.4 | 82.4 | 93.2 | 58.9 | |
| BadChainAgent Backbone=LLaMA3, Retriever Type=contrastive-retriever2024.07 | 82 | 43.2 | 92.4 | 41.3 | |
| AutoDANAgent Backbone=LLaMA3, Retriever Type=end-to-end-retriever2024.07 | 81.7 | 62.6 | 55.3 | 49.6 | |
| GCGAgent Backbone=LLaMA3, Retriever Type=end-to-end-retriever2024.07 | 80.4 | 14.8 | 88.5 | 38 | |
| CPAAgent Backbone=LLaMA3, Retriever Type=end-to-end-retriever2024.07 | 79.3 | 72.9 | 44.3 | 51.2 | |
| CPAAgent Backbone=LLaMA3, Retriever Type=contrastive-retriever2024.07 | 78.4 | 69.7 | 91.2 | 51.5 | |
| BadChainAgent Backbone=LLaMA3, Retriever Type=end-to-end-retriever2024.07 | 78.4 | 35.6 | 85.5 | 50.3 |