Commonsense Question Answering on CSQA (Acc, Uintra, Uinter, Usys)
98.9AccuracyClean (no attack)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Clean (no attack)Defense=—2026.07 | 98.9 | — | — | — | |
| AcMASDefense=Correction2026.07 | 98.6 | — | — | — | |
| UDPO# compromised agents=12026.02 | 85.1 | 0.098 | 0.072 | 0.108 | |
| G-SafeguardDefense=Isolation2026.07 | 78.9 | — | — | — | |
| UDPO# compromised agents=22026.02 | 76.4 | 0.148 | 0.112 | 0.162 | |
| UDPO# compromised agents=32026.02 | 73.9 | 0.215 | 0.168 | 0.235 | |
| BlindGuardDefense=Isolation2026.07 | 73.5 | — | — | — | |
| RMAAC# compromised agents=12026.02 | 69.5 | 0.205 | 0.162 | 0.275 | |
| LoraHubSetting=single-task, Number of runs=52026.06 | 66.1 | — | — | — | |
| EMMSetting=single-task, Number of runs=52026.06 | 65.9 | — | — | — | |
| Expert FusionSetting=single-task, Number of runs=52026.06 | 65 | — | — | — | |
| Best Single ExpertSetting=single-task, Number of runs=52026.06 | 64.3 | — | — | — | |
| MERGEvolveSetting=single-task, Number of runs=52026.06 | 64.3 | — | — | — | |
| Pack of LLMsSetting=single-task, Number of runs=52026.06 | 63.3 | — | — | — | |
| Standard MAD# compromised agents=12026.02 | 63.2 | 0.31 | 0.205 | 0.338 | |
| Model SwarmsSetting=single-task, Number of runs=52026.06 | 63.2 | — | — | — | |
| RMAAC# compromised agents=22026.02 | 59.8 | 0.258 | 0.215 | 0.355 | |
| MAPPO# compromised agents=12026.02 | 58 | 0.215 | 0.172 | 0.288 | |
| MAPPO# compromised agents=22026.02 | 56.9 | 0.275 | 0.228 | 0.378 | |
| Standard MAD# compromised agents=22026.02 | 51.6 | 0.335 | 0.275 | 0.442 | |
| RMAAC# compromised agents=32026.02 | 48.6 | 0.318 | 0.278 | 0.438 | |
| MAPPO# compromised agents=32026.02 | 44.8 | 0.342 | 0.295 | 0.472 | |
| Data MergeSetting=single-task, Number of runs=52026.06 | 37.4 | — | — | — | |
| Standard MAD# compromised agents=32026.02 | 29.7 | 0.512 | 0.552 | 0.573 | |
| TIESSetting=single-task, Number of runs=52026.06 | 28 | — | — | — | |
| Attack-only (no defense)Defense=No2026.07 | 16.1 | — | — | — |