List your company
ResearchFormerly WizWand

Text Classification on IMDB (test) (Adversarial Robustness Metrics)

3.6Attack Success Ratehoneypot defense
0.08823.79447.571.206May 27, 2023Jun 21, 2023Jul 17, 2023Aug 12, 2023Sep 6, 2023Oct 2, 2023Oct 28, 2023
Updated 8mo ago

Evaluation results

MethodLinks
honeypot defenseVictim=RoBERTa_LARGE, Attack=AddWord2023.103.6——94.12
honeypot defenseVictim=RoBERTa_BASE, Attack=AddWord2023.105.6——93.72
honeypot defenseVictim=BERT_LARGE, Attack=AddWord2023.105.84——92.6
honeypot defenseVictim=RoBERTa_LARGE, Attack=AddSent2023.106.32——93.68
honeypot defenseVictim=RoBERTa_BASE, Attack=AddSent2023.106.56——92.72
honeypot defenseVictim=BERT_BASE, Attack=AddWord2023.107.2——91.32
honeypot defenseVictim=BERT_BASE, Attack=AddSent2023.108.16——91
honeypot defenseVictim=BERT_LARGE, Attack=AddSent2023.109.52——92.12
honeypot defenseVictim=RoBERTa_LARGE, Attack=Average2023.1011.58——94.08
honeypot defenseVictim=RoBERTa_BASE, Attack=Average2023.1013.56——93.19
honeypot defenseVictim=BERT_LARGE, Attack=Average2023.1014.76——92.36
honeypot defenseVictim=BERT_BASE, Attack=Average2023.1014.89——90.2
honeypot defenseVictim=RoBERTa_LARGE, Attack=StyleBKD2023.1017.9——94.5
honeypot defenseVictim=RoBERTa_LARGE, Attack=SynBKD2023.1018.4——94
honeypot defenseVictim=BERT_LARGE, Attack=StyleBKD2023.1018.7——92.76
honeypot defenseVictim=RoBERTa_BASE, Attack=StyleBKD2023.1019.36——93.12
honeypot defenseVictim=BERT_BASE, Attack=StyleBKD2023.1020.6——89.44
honeypot defenseVictim=RoBERTa_BASE, Attack=SynBKD2023.1022.7——93.2
honeypot defenseVictim=BERT_BASE, Attack=SynBKD2023.1023.6——89.04
honeypot defenseVictim=BERT_LARGE, Attack=SynBKD2023.1024.96——91.96
BERT-AttackVictim Model=BERT2023.0588.25.30.78—
SDM-ATTACKVictim Model=RoBERTa2023.0588.38.30.7—
TextFoolerVictim Model=BERT2023.0588.77.60.76—
SDM-ATTACKVictim Model=WordCNN2023.0589.23.30.85—
SDM-ATTACKVictim Model=WordLSTM2023.0589.85.40.75—
A2TVictim Model=BERT2023.0589.94.40.79—
SDM-ATTACKVictim Model=BERT2023.0591.44.10.82—