Multitask Language Understanding on MMLU physics
90.1MDRA-Trust
Evaluation results
| Method | Links | |
|---|---|---|
| A-TrustAgent Structure=Chain, Attack=AutoInj, Backbone=Llama3.1-8B-Instruct2025.06 | 90.1 | |
| A-TrustAgent Structure=Tree, Attack=AutoInj, Backbone=Llama3.1-8B-Instruct2025.06 | 89.3 | |
| A-TrustAgent Structure=Complete, Attack=AutoInj, Backbone=Llama3.1-8B-Instruct2025.06 | 87.7 | |
| A-TrustAgent Structure=Complete, Attack=AiTM, Backbone=Llama3.1-8B-Instruct2025.06 | 85.4 | |
| A-TrustAgent Structure=Tree, Attack=AiTM, Backbone=Llama3.1-8B-Instruct2025.06 | 84.7 | |
| A-TrustAgent Structure=Chain, Attack=AiTM, Backbone=Llama3.1-8B-Instruct2025.06 | 84.3 | |
| A-TrustAgent Structure=Tree, Attack=NetSafe, Backbone=Llama3.1-8B-Instruct2025.06 | 83.6 | |
| A-TrustAgent Structure=Complete, Attack=NetSafe, Backbone=Llama3.1-8B-Instruct2025.06 | 82.7 | |
| A-TrustAgent Structure=Tree, Attack=AutoTrans, Backbone=Llama3.1-8B-Instruct2025.06 | 82.1 | |
| A-TrustAgent Structure=Complete, Attack=AutoTrans, Backbone=Llama3.1-8B-Instruct2025.06 | 80.5 | |
| A-TrustAgent Structure=Chain, Attack=NetSafe, Backbone=Llama3.1-8B-Instruct2025.06 | 79.6 | |
| A-TrustAgent Structure=Chain, Attack=AutoTrans, Backbone=Llama3.1-8B-Instruct2025.06 | 77.5 | |
| PromptAgent Structure=Tree, Attack=AutoTrans, Backbone=Llama3.1-8B-Instruct2025.06 | 61.7 | |
| PromptAgent Structure=Complete, Attack=AutoTrans, Backbone=Llama3.1-8B-Instruct2025.06 | 60.8 | |
| PromptAgent Structure=Tree, Attack=AutoInj, Backbone=Llama3.1-8B-Instruct2025.06 | 60.8 | |
| PPLAgent Structure=Complete, Attack=AutoInj, Backbone=Llama3.1-8B-Instruct2025.06 | 60.7 | |
| PPLAgent Structure=Tree, Attack=AutoInj, Backbone=Llama3.1-8B-Instruct2025.06 | 60.4 | |
| PromptAgent Structure=Complete, Attack=AutoInj, Backbone=Llama3.1-8B-Instruct2025.06 | 59.3 | |
| PPLAgent Structure=Chain, Attack=AutoInj, Backbone=Llama3.1-8B-Instruct2025.06 | 57.9 | |
| PromptAgent Structure=Chain, Attack=AutoTrans, Backbone=Llama3.1-8B-Instruct2025.06 | 57.7 | |
| PromptAgent Structure=Tree, Attack=NetSafe, Backbone=Llama3.1-8B-Instruct2025.06 | 56.2 | |
| PromptAgent Structure=Chain, Attack=AutoInj, Backbone=Llama3.1-8B-Instruct2025.06 | 55.3 | |
| PromptAgent Structure=Tree, Attack=AiTM, Backbone=Llama3.1-8B-Instruct2025.06 | 54.2 | |
| PromptAgent Structure=Complete, Attack=AiTM, Backbone=Llama3.1-8B-Instruct2025.06 | 53.8 | |
| PPLAgent Structure=Complete, Attack=AutoTrans, Backbone=Llama3.1-8B-Instruct2025.06 | 53.7 | |
| PromptAgent Structure=Complete, Attack=NetSafe, Backbone=Llama3.1-8B-Instruct2025.06 | 53.1 | |
| PromptAgent Structure=Chain, Attack=AiTM, Backbone=Llama3.1-8B-Instruct2025.06 | 52.9 | |
| PPLAgent Structure=Chain, Attack=AutoTrans, Backbone=Llama3.1-8B-Instruct2025.06 | 51.8 | |
| PPLAgent Structure=Tree, Attack=AiTM, Backbone=Llama3.1-8B-Instruct2025.06 | 50.9 | |
| PPLAgent Structure=Chain, Attack=NetSafe, Backbone=Llama3.1-8B-Instruct2025.06 | 50.5 | |
| PPLAgent Structure=Tree, Attack=NetSafe, Backbone=Llama3.1-8B-Instruct2025.06 | 50.4 | |
| PromptAgent Structure=Chain, Attack=NetSafe, Backbone=Llama3.1-8B-Instruct2025.06 | 50.3 | |
| PPLAgent Structure=Complete, Attack=NetSafe, Backbone=Llama3.1-8B-Instruct2025.06 | 50.2 | |
| PPLAgent Structure=Tree, Attack=AutoTrans, Backbone=Llama3.1-8B-Instruct2025.06 | 48.9 | |
| PPLAgent Structure=Complete, Attack=AiTM, Backbone=Llama3.1-8B-Instruct2025.06 | 44.3 | |
| PPLAgent Structure=Chain, Attack=AiTM, Backbone=Llama3.1-8B-Instruct2025.06 | 43.1 | |
| A-TrustAgent Structure=Complete, Attack=Clean, Backbone=Llama3.1-8B-Instruct2025.06 | 9.6 | |
| PromptAgent Structure=Tree, Attack=Clean, Backbone=Llama3.1-8B-Instruct2025.06 | 9.5 | |
| PromptAgent Structure=Chain, Attack=Clean, Backbone=Llama3.1-8B-Instruct2025.06 | 9.4 | |
| A-TrustAgent Structure=Tree, Attack=Clean, Backbone=Llama3.1-8B-Instruct2025.06 | 8.2 | |
| A-TrustAgent Structure=Chain, Attack=Clean, Backbone=Llama3.1-8B-Instruct2025.06 | 7.1 | |
| PromptAgent Structure=Complete, Attack=Clean, Backbone=Llama3.1-8B-Instruct2025.06 | 5.7 | |
| PPLAgent Structure=Chain, Attack=Clean, Backbone=Llama3.1-8B-Instruct2025.06 | 4.8 | |
| PPLAgent Structure=Complete, Attack=Clean, Backbone=Llama3.1-8B-Instruct2025.06 | 4.5 | |
| PPLAgent Structure=Tree, Attack=Clean, Backbone=Llama3.1-8B-Instruct2025.06 | 3.1 |