Program Synthesis on MBPP (Clean Error, ASR)
88.4ASRNo trust
Evaluation results
| Method | Links | ||
|---|---|---|---|
| No trustCommunication Structure=Tree, Attack Type=AiTM2025.06 | 88.4 | — | |
| No trustCommunication Structure=Chain, Attack Type=AiTM2025.06 | 83.4 | — | |
| No trustCommunication Structure=Complete, Attack Type=AiTM2025.06 | 73.5 | — | |
| No trustCommunication Structure=Chain, Attack Type=AutoTrans2025.06 | 65.1 | — | |
| No trustCommunication Structure=Chain, Attack Type=NetSafe2025.06 | 62.4 | — | |
| No trustCommunication Structure=Chain, Attack Type=AutoInj2025.06 | 56.2 | — | |
| A-TrustCommunication Structure=Chain, Attack Type=AutoTrans2025.06 | 45.7 | — | |
| A-TrustCommunication Structure=Chain, Attack Type=AutoInj2025.06 | 45.2 | — | |
| A-TrustCommunication Structure=Chain, Attack Type=NetSafe2025.06 | 43.1 | — | |
| A-TrustCommunication Structure=Complete, Attack Type=AiTM2025.06 | 22.8 | — | |
| A-TrustCommunication Structure=Tree, Attack Type=AiTM2025.06 | 19.5 | — | |
| A-TrustCommunication Structure=Chain, Attack Type=AiTM2025.06 | 17.2 | — | |
| A-TrustCommunication Structure=Chain, Attack Type=Clean2025.06 | — | 37.5 | |
| A-TrustCommunication Structure=Complete, Attack Type=Clean2025.06 | — | 32.8 | |
| A-TrustCommunication Structure=Tree, Attack Type=Clean2025.06 | — | 31.1 | |
| No trustCommunication Structure=Chain, Attack Type=Clean2025.06 | — | 35.9 | |
| No trustCommunication Structure=Complete, Attack Type=Clean2025.06 | — | 28.7 | |
| No trustCommunication Structure=Tree, Attack Type=Clean2025.06 | — | 29.5 |