Target behavior attack on MBPP
99.2ASRAiTM
Evaluation results
| Method | Links | |
|---|---|---|
| AiTMFramework=MetaGPT, Victim Agent=Architect2025.02 | 99.2 | |
| AiTMFramework=Camel, Communication Structure=Chain2025.02 | 98.5 | |
| AiTMFramework=AutoGen, Communication Structure=Chain2025.02 | 96.9 | |
| AiTMFramework=MetaGPT, Victim Agent=Project Manager2025.02 | 96.3 | |
| AiTMFramework=Camel, Communication Structure=Complete2025.02 | 95.9 | |
| AiTMFramework=MetaGPT, Victim Agent=Product manager2025.02 | 95.1 | |
| AiTMFramework=AutoGen, Communication Structure=Complete2025.02 | 92.4 | |
| AiTMFramework=Camel, Communication Structure=Tree2025.02 | 92.3 | |
| AiTMFramework=AutoGen, Communication Structure=Tree2025.02 | 90.5 | |
| AiTMFramework=MetaGPT, Victim Agent=Engineer2025.02 | 80.4 | |
| AiTMFramework=AutoGen, Communication Structure=Random2025.02 | 76.8 | |
| AiTMFramework=Camel, Communication Structure=Random2025.02 | 73.1 | |
| AiTMFramework=ChatDev, Victim Agent=Programmer2025.02 | 69.3 | |
| AiTMFramework=ChatDev, Victim Agent=CTO2025.02 | 55.9 | |
| AiTMFramework=ChatDev, Victim Agent=CPO2025.02 | 0 | |
| AiTMFramework=ChatDev, Victim Agent=CEO2025.02 | 0 |