Commonsense Reasoning on StrategyQA (Clean Error and ASR)
32.2Clean ErrorNo trust
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| No trustCommunication Structure=Complete, Attack Type=Clean2025.06 | 32.2 | — | |
| No trustCommunication Structure=Chain, Attack Type=Clean2025.06 | 34.3 | — | |
| No trustCommunication Structure=Tree, Attack Type=Clean2025.06 | 34.8 | — | |
| A-TrustCommunication Structure=Complete, Attack Type=Clean2025.06 | 34.9 | — | |
| A-TrustCommunication Structure=Chain, Attack Type=Clean2025.06 | 36.2 | — | |
| A-TrustCommunication Structure=Tree, Attack Type=Clean2025.06 | 36.7 | — | |
| A-TrustCommunication Structure=Chain, Attack Type=AiTM2025.06 | — | 20.8 | |
| A-TrustCommunication Structure=Complete, Attack Type=AiTM2025.06 | — | 18.7 | |
| A-TrustCommunication Structure=Tree, Attack Type=AiTM2025.06 | — | 21.7 | |
| No trustCommunication Structure=Chain, Attack Type=AiTM2025.06 | — | 90.3 | |
| No trustCommunication Structure=Complete, Attack Type=AiTM2025.06 | — | 90.1 | |
| No trustCommunication Structure=Tree, Attack Type=AiTM2025.06 | — | 80.5 |