Adversarial Attack Success Rate on Multi-agent Communication Scenarios (test)
0ASR (Clean)Conjunctive Prompt Attack
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Conjunctive Prompt AttackModel=Gemma-2B, Topology=Star, Optimization Level=routing2026.04 | 0 | 20 | 10 | 40 | |
| Conjunctive Prompt AttackModel=Gemma-2B, Topology=Star, Optimization Level=routing+key placement2026.04 | 0 | 0 | 20 | 60 | |
| Conjunctive Prompt AttackModel=Gemma-2B, Topology=Star, Optimization Level=full optimization2026.04 | 0 | 10 | 10 | 60 | |
| Conjunctive Prompt AttackModel=Gemma-2B, Topology=Chain, Optimization Level=routing2026.04 | 0 | 10 | 20 | 60 | |
| Conjunctive Prompt AttackModel=Gemma-2B, Topology=Chain, Optimization Level=routing+key placement2026.04 | 0 | 20 | 10 | 30 | |
| Conjunctive Prompt AttackModel=Gemma-2B, Topology=Chain, Optimization Level=full optimization2026.04 | 0 | 0 | 40 | 80 | |
| Conjunctive Prompt AttackModel=Gemma-2B, Topology=DAG, Optimization Level=routing2026.04 | 0 | 0 | 20 | 40 | |
| Conjunctive Prompt AttackModel=Gemma-2B, Topology=DAG, Optimization Level=routing+key placement2026.04 | 0 | 0 | 10 | 40 | |
| Conjunctive Prompt AttackModel=Gemma-2B, Topology=DAG, Optimization Level=full optimization2026.04 | 0 | 30 | 50 | 100 | |
| Conjunctive Prompt AttackModel=Mistral-7B, Topology=Star, Optimization Level=routing2026.04 | 0 | 10 | 20 | 60 | |
| Conjunctive Prompt AttackModel=Mistral-7B, Topology=Star, Optimization Level=routing+key placement2026.04 | 0 | 0 | 30 | 40 | |
| Conjunctive Prompt AttackModel=Mistral-7B, Topology=Star, Optimization Level=full optimization2026.04 | 0 | 20 | 40 | 90 | |
| Conjunctive Prompt AttackModel=Mistral-7B, Topology=Chain, Optimization Level=routing2026.04 | 0 | 0 | 10 | 80 | |
| Conjunctive Prompt AttackModel=Mistral-7B, Topology=Chain, Optimization Level=routing+key placement2026.04 | 0 | 10 | 40 | 100 | |
| Conjunctive Prompt AttackModel=Mistral-7B, Topology=Chain, Optimization Level=full optimization2026.04 | 0 | 10 | 50 | 100 | |
| Conjunctive Prompt AttackModel=Mistral-7B, Topology=DAG, Optimization Level=routing2026.04 | 0 | 10 | 10 | 40 | |
| Conjunctive Prompt AttackModel=Mistral-7B, Topology=DAG, Optimization Level=routing+key placement2026.04 | 0 | 0 | 20 | 80 | |
| Conjunctive Prompt AttackModel=Mistral-7B, Topology=DAG, Optimization Level=full optimization2026.04 | 0 | 10 | 40 | 100 | |
| Conjunctive Prompt AttackModel=LLaMA3-8B, Topology=Star, Optimization Level=routing2026.04 | 0 | 20 | 10 | 30 | |
| Conjunctive Prompt AttackModel=LLaMA3-8B, Topology=Star, Optimization Level=routing+key placement2026.04 | 0 | 0 | 20 | 60 | |
| Conjunctive Prompt AttackModel=LLaMA3-8B, Topology=Star, Optimization Level=full optimization2026.04 | 0 | 10 | 40 | 70 | |
| Conjunctive Prompt AttackModel=LLaMA3-8B, Topology=Chain, Optimization Level=routing2026.04 | 0 | 0 | 10 | 50 | |
| Conjunctive Prompt AttackModel=LLaMA3-8B, Topology=Chain, Optimization Level=routing+key placement2026.04 | 0 | 0 | 10 | 60 | |
| Conjunctive Prompt AttackModel=LLaMA3-8B, Topology=Chain, Optimization Level=full optimization2026.04 | 0 | 20 | 20 | 80 | |
| Conjunctive Prompt AttackModel=LLaMA3-8B, Topology=DAG, Optimization Level=routing2026.04 | 0 | 0 | 10 | 40 | |
| Conjunctive Prompt AttackModel=LLaMA3-8B, Topology=DAG, Optimization Level=routing+key placement2026.04 | 0 | 10 | 30 | 80 | |
| Conjunctive Prompt AttackModel=LLaMA3-8B, Topology=DAG, Optimization Level=full optimization2026.04 | 0 | 20 | 60 | 100 |