List your company
ResearchFormerly WizWand

Backdoor Defense on AgNews

2.03Attack Success RateMuScleLoRA
-1.887224.553950.99577.4361May 8, 2023Oct 28, 2023Apr 19, 2024Oct 10, 2024Apr 2, 2025Sep 23, 2025Mar 16, 2026
Updated 7mo ago

Evaluation results

MethodLinks
MuScleLoRAAttack=Wordbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.032.03—88.35——
MuScleLoRAAttack=Badnets, Target LM=BERT-base2024.022.35—87.74——
AdapterAttack=Badnets, Target LM=BERT-base2024.022.56—89.64——
MuScleLoRAAttack=StyleBkd, Target LM=BERT-base2024.022.67—87.97——
MuScleLoRAAttack=Stylebkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.033.1—88.16——
LoRAAttack=Badnets, Target LM=BERT-base2024.023.28—89.59——
Fine-purifyingModel=BERT, Backdoor Attack=BadWord2023.053.390.86———
MuScleLoRAAttack=Addsent, Target LM=BERT-base2024.023.9—87.72——
Fine-purifyingModel=RoBERTa, Backdoor Attack=BadSent2023.055.7290.79———
BadLLM-TGAttack=Sentbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.036.12—93.86——
ONIONAttack=Wordbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.036.75—92.69——
W2SDefenseBackbone=Qwen2.5, Attack Method=BadNet2024.106.8—91.8——
PruneBackbone=LLAMA3, Attack Method=BadNet2024.107.07—92.2——
W2SDefenseBackbone=LLAMA3, Attack Method=BadNet2024.107.07—90.7——
W2SDefenseBackbone=Qwen2.5, Attack Method=InSent2024.108.4—92.4——
W2SDefenseBackbone=LLAMA3, Attack Method=InSent2024.108.67—90.3——
W2SDefenseBackbone=Vicuna, Attack Method=BadNet2024.109.33—93.1——
BadLLM-TGAttack=Wordbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0310.25—93.04——
Fine-mixingModel=BERT, Backdoor Attack=BadWord2023.0512.3290.17———
BadLLM-TGAttack=Synbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0313.63—89.61——
Fine-mixingModel=RoBERTa, Backdoor Attack=BadWord2023.0515.0290.49———
W2SDefenseBackbone=Qwen2.5, Attack Method=SynAttack2024.1016.4—92.1——
MuScleLoRAAttack=HiddenKiller, Target LM=BERT-base2024.0217.02—86.05——
Fine-purifyingModel=RoBERTa, Backdoor Attack=BadWord2023.0517.3791.1———
BadLLM-TGAttack=Stylebkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0319.64—88.96——
SCPDBackbone=Qwen2.5, Attack Method=InSent2024.1022.67—86.7——
Back Tr.Backbone=LLAMA3, Attack Method=BadNet2024.1022.93—88.3——
Fine-purifyingModel=BERT, Backdoor Attack=BadSent2023.0523.6991.13———
Fine-mixingModel=RoBERTa, Backdoor Attack=BadSent2023.0523.9890.29———
Back Tr.Backbone=Vicuna, Attack Method=BadNet2024.1024.8—90.3——
PruneBackbone=Qwen2.5, Attack Method=SynAttack2024.1024.8—91.6——
Back Tr.Backbone=Qwen2.5, Attack Method=BadNet2024.1028—91.3——
SCPDBackbone=Qwen2.5, Attack Method=BadNet2024.1030.13—87.7——
Back Tr.Backbone=Vicuna, Attack Method=InSent2024.1030.8—88.3——
Back Tr.Backbone=Qwen2.5, Attack Method=SynAttack2024.1031.07—92——
ONIONBackbone=LLAMA3, Attack Method=BadNet2024.1031.59—59.3——
Fine-mixingModel=BERT, Backdoor Attack=BadSent2023.0532.3790.4———
W2SDefenseBackbone=Vicuna, Attack Method=InSent2024.1032.8—91.2——
W2SDefenseBackbone=LLAMA3, Attack Method=SynAttack2024.1037.6—91.6——
PruneBackbone=Qwen2.5, Attack Method=BadNet2024.1040.93—93.4——
Back Tr.Backbone=LLAMA3, Attack Method=SynAttack2024.1044.4—86.2——
AdapterAttack=StyleBkd, Target LM=BERT-base2024.0250.18—89.03——
PrefixAttack=Badnets, Target LM=BERT-base2024.0250.37—90.85——
VanillaAttack=Badnets, Target LM=BERT-base2024.0251.25—92.8——
SCPDBackbone=Vicuna, Attack Method=InSent2024.1052.8—70.5——
PruneBackbone=LLAMA3, Attack Method=SynAttack2024.1055.47—92.5——
SCPDBackbone=Qwen2.5, Attack Method=SynAttack2024.1055.47—72.4——
BadActsAttack=Synbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0357.24—92.2——
SCPDBackbone=Vicuna, Attack Method=BadNet2024.1057.33—63.8——
SCPDBackbone=LLAMA3, Attack Method=SynAttack2024.1059.47—52.4——
RAPAttack=Wordbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0359.67—93.7——
PruneBackbone=LLAMA3, Attack Method=InSent2024.1060.67—92.2——
BadActsAttack=Stylebkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0361.78—92.06——
Back Tr.Backbone=Qwen2.5, Attack Method=InSent2024.1062.93—92.1——
SCPDBackbone=LLAMA3, Attack Method=BadNet2024.1063.33—51.8——
ONIONBackbone=Vicuna, Attack Method=InSent2024.1066.26—84.7——
ONIONBackbone=Qwen2.5, Attack Method=BadNet2024.1069.46—92.5——
ONIONBackbone=Vicuna, Attack Method=BadNet2024.1069.6—78——
SCPDBackbone=LLAMA3, Attack Method=InSent2024.1069.74—50.3——
BadActsAttack=Sentbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0372.95—92.19——
Back Tr.Backbone=LLAMA3, Attack Method=InSent2024.1074.13—82.1——
PruneBackbone=Vicuna, Attack Method=InSent2024.1076.93—92.1——
LoRABackbone=Qwen2.5, Attack Method=SynAttack2024.1077.6—93.3——
LoRAAttack=StyleBkd, Target LM=BERT-base2024.0277.76—88.39——
PrefixAttack=StyleBkd, Target LM=BERT-base2024.0278.69—90——
RAPAttack=Sentbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0380—79.94——
ONIONAttack=Sentbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0381.62—93.16——
PruneBackbone=Vicuna, Attack Method=SynAttack2024.1082.67—92.5——
ONIONBackbone=Qwen2.5, Attack Method=SynAttack2024.1082.8—93——
No-DefenseAttack=Wordbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0383.55—93.97——
LoRABackbone=LLAMA3, Attack Method=BadNet2024.1083.6—92.9——
VanillaAttack=StyleBkd, Target LM=BERT-base2024.0287.59—92.06——
ONIONBackbone=LLAMA3, Attack Method=SynAttack2024.1087.6—89.6——
Back Tr.Backbone=Vicuna, Attack Method=SynAttack2024.1089.2—47.2——
RAPAttack=Stylebkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0390.06—92.24——
LoRABackbone=LLAMA3, Attack Method=InSent2024.1090.67—93.1——
LoRABackbone=Vicuna, Attack Method=InSent2024.1091.6—93.3——
PruneBackbone=Qwen2.5, Attack Method=InSent2024.1092—92.6——
ONIONAttack=Stylebkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0392.76—92.22——
BadActsAttack=Wordbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0392.83—92.12——
No-DefenseAttack=Synbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0393.55—94.26——
AdapterAttack=HiddenKiller, Target LM=BERT-base2024.0293.75—88.86——
PruneBackbone=Vicuna, Attack Method=BadNet2024.1094—91.3——
LoRABackbone=LLAMA3, Attack Method=SynAttack2024.1094.8—91.1——
LoRABackbone=Vicuna, Attack Method=SynAttack2024.1095.2—92.7——
SCPDBackbone=Vicuna, Attack Method=SynAttack2024.1095.33—34.7——
ONIONAttack=Synbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0396.52—93.23——
MuScleLoRAAttack=Synbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0397.29—87.46——
ONIONBackbone=Qwen2.5, Attack Method=InSent2024.1097.86—92.6——
LoRABackbone=Vicuna, Attack Method=BadNet2024.1098—92.4——
LoRAAttack=HiddenKiller, Target LM=BERT-base2024.0298.16—89.01——
ONIONBackbone=Vicuna, Attack Method=SynAttack2024.1098.4—77.5——
LoRABackbone=Qwen2.5, Attack Method=BadNet2024.1098.53—93.2——
PrefixAttack=HiddenKiller, Target LM=BERT-base2024.0298.75—90.62——
ONIONBackbone=LLAMA3, Attack Method=InSent2024.1099.2—71.9——
VanillaAttack=HiddenKiller, Target LM=BERT-base2024.0299.47—92.78——
LoRABackbone=Qwen2.5, Attack Method=InSent2024.1099.47—93.1——
RAPAttack=Synbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0399.79—93.61——
No-DefenseAttack=Stylebkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0399.83—94.24——
MuScleLoRAAttack=Sentbkd, Victim Model=BERT-base-uncased, Poisoning Rate=20%2026.0399.96—87.97——