List your company
ResearchFormerly WizWand

Adversarial Text Detection on IMDB (test)

97.8F1 ScoreVoteTRANS
64.31273.00681.790.394Jun 2, 2023
Updated 8mo ago

Evaluation results

MethodLinks
VoteTRANSTarget Model=DistilBERT, Attack=TextFooler, Auxiliary attack=Same2023.0697.899.6
VoteTRANSTarget Model=DistilBERT, Attack=TextFooler, Auxiliary attack=PWWS2023.0697.7100
VoteTRANSTarget Model=DistilBERT, Attack=BAE, Auxiliary attack=Same2023.0697.7100
VoteTRANSTarget Model=BERT, Attack=PWWS, Auxiliary attack=Same2023.0697.498.4
VoteTRANSTarget Model=DistilBERT, Attack=PWWS, Auxiliary attack=Same2023.0696.998.4
VoteTRANSTarget Model=DistilBERT, Attack=BAE, Auxiliary attack=PWWS2023.0696.399.2
VoteTRANSTarget Model=DistilBERT, Attack=IGA, Auxiliary attack=PWWS2023.0695.999.2
VoteTRANSTarget Model=DistilBERT, Attack=IGA, Auxiliary attack=Same2023.0695.899.2
VoteTRANSTarget Model=CNN, Attack=PWWS, Auxiliary attack=Same2023.0695.498.8
VoteTRANSTarget Model=LSTM, Attack=PWWS, Auxiliary attack=Same2023.0694.897.6
WDRTarget Model=DistilBERT, Attack=TextFooler, Detector training configuration=DistilBERT, IMDB, PWWS2023.0694.297.3
WDRTarget Model=BERT, Attack=PWWS, Detector training configuration=DistilBERT, IMDB, PWWS2023.0692.492.5
WDRTarget Model=DistilBERT, Attack=PWWS, Detector training configuration=DistilBERT, IMDB, PWWS2023.0692.194.2
FGWSTarget Model=BERT, Attack=PWWS, Detector training configuration=DistilBERT, IMDB, PWWS2023.0689.882.7
FGWSTarget Model=DistilBERT, Attack=PWWS, Detector training configuration=DistilBERT, IMDB, PWWS2023.0689.582.7
WDRTarget Model=DistilBERT, Attack=IGA, Detector training configuration=DistilBERT, IMDB, PWWS2023.0688.595.5
WDRTarget Model=DistilBERT, Attack=BAE, Detector training configuration=DistilBERT, IMDB, PWWS2023.068896.3
FGWSTarget Model=CNN, Attack=PWWS, Detector training configuration=DistilBERT, IMDB, PWWS2023.0686.379.6
FGWSTarget Model=DistilBERT, Attack=TextFooler, Detector training configuration=DistilBERT, IMDB, PWWS2023.068677.6
WDRTarget Model=CNN, Attack=PWWS, Detector training configuration=DistilBERT, IMDB, PWWS2023.0684.390
WDRTarget Model=LSTM, Attack=PWWS, Detector training configuration=DistilBERT, IMDB, PWWS2023.0684.186.8
FGWSTarget Model=DistilBERT, Attack=IGA, Detector training configuration=DistilBERT, IMDB, PWWS2023.0683.874.8
FGWSTarget Model=LSTM, Attack=PWWS, Detector training configuration=DistilBERT, IMDB, PWWS2023.068069.6
FGWSTarget Model=DistilBERT, Attack=BAE, Detector training configuration=DistilBERT, IMDB, PWWS2023.0665.650.2