Sentiment Classification on SST2 (test)
96AccuracyPrivateLoRA
Evaluation results
| Method | Links | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PrivateLoRAAdaptation=PrivateLoRA, LLM Type=Open, Model=Llama3-8B(instruct), Reveals=None2024.11 | 96 | — | — | — | — | — | — | — | — | 27.6 | 0.78 | — | — | — | — | — | — | — | |
| DP-ICLAdaptation=DP-ICL, LLM Type=Closed, Model=GPT4 Turbo, Reveals=DT+Q2024.11 | 95.9 | — | — | — | — | — | — | — | — | 0 | 138 | — | — | — | — | — | — | — | |
| NoiseALNoise Level=20%I2025.04 | 94.45 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NoiseALNoise Level=20%A2025.04 | 94.32 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NoiseALNoise Level=20%S2025.04 | 94.21 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ICL-goldPrompting Method=Direct, Backbone=GPT-3, Oracle=true2022.12 | 94.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ICL-randomPrompting Method=Direct, Backbone=GPT-3, Oracle=true2022.12 | 93.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CLNoise Level=20%A2025.04 | 93.45 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BERT-largeBackbone=BERT-large, Design=Human-designed2025.01 | 93.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NoiseALNoise Level=40%S2025.04 | 92.83 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NoiseALNoise Level=40%A2025.04 | 92.71 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| w/o defenceAttack=DeepWordBug, Mask Ratio=0%2024.06 | 92.69 | — | — | — | 93.04 | 6.96 | — | — | — | — | — | — | — | — | — | — | — | — | |
| w/o defenceAttack=TextFooler, Mask Ratio=0%2024.06 | 92.69 | — | — | — | 91.87 | 8.13 | — | — | — | — | — | — | — | — | — | — | — | — | |
| w/o defenceAttack=TrojLLM, Mask Ratio=0%2024.06 | 92.69 | — | — | — | 91.88 | 53.76 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DOLPHIN (Best Idea)Backbone=BERT-base, Mode=Maximum improvement2025.01 | 92.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MMR + Feedback-ICLSelection Strategy=MMR2024.06 | 92.49 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| w/o defenceAttack=UAT, Mask Ratio=0%2024.06 | 92.48 | — | — | — | 96.85 | 52.97 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Co-TeachingNoise Level=20%S2025.04 | 92.41 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LoRA-SAMBackbone=RoBERTa-large, Number of Parameters=355M, Evaluation Protocol=few-shot2024.10 | 92.2 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| K-Means + Feedback-ICLSelection Strategy=K-Means2024.06 | 92.09 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SG2026.04 | 91.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NDT [0,1]Ncomp=32026.03 | 91.85 | — | — | — | — | — | — | — | — | — | — | 91.8 | 91.9 | 0.962 | — | — | — | — | |
| NDT [-1,1]Ncomp=22026.03 | 91.83 | — | — | — | — | — | — | — | — | — | — | 91.8 | 91.9 | 0.965 | — | — | — | — | |
| DOLPHIN (Average Idea)Backbone=BERT-base, Mode=Average of improved ideas2025.01 | 91.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NoiseALNoise Level=40%I2025.04 | 91.78 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ELRNoise Level=20%A2025.04 | 91.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CLNoise Level=20%S2025.04 | 91.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NDT [0,1]Ncomp=22026.03 | 91.74 | — | — | — | — | — | — | — | — | — | — | 91.7 | 91.7 | 0.964 | — | — | — | — | |
| BM25 + Feedback-ICLSelection Strategy=BM252024.06 | 91.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NDT (−∞,∞)Ncomp=32026.03 | 91.7 | — | — | — | — | — | — | — | — | — | — | 91.7 | 91.7 | 0.964 | — | — | — | — | |
| NDT [-1,1]Ncomp=32026.03 | 91.67 | — | — | — | — | — | — | — | — | — | — | 91.8 | 91.7 | 0.962 | — | — | — | — | |
| NDT [0,1]Ncomp=42026.03 | 91.65 | — | — | — | — | — | — | — | — | — | — | 91.6 | 91.6 | 0.963 | — | — | — | — | |
| NDT [-1,1]Ncomp=42026.03 | 91.65 | — | — | — | — | — | — | — | — | — | — | 91.6 | 91.6 | 0.963 | — | — | — | — | |
| Co-TeachingNoise Level=20%A2025.04 | 91.57 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Differential TransformerNcomp=22026.03 | 91.53 | — | — | — | — | — | — | — | — | — | — | 91.5 | 91.5 | 0.971 | — | — | — | — | |
| NDT [0,∞)Ncomp=32026.03 | 91.52 | — | — | — | — | — | — | — | — | — | — | 91.5 | 91.5 | 0.964 | — | — | — | — | |
| LoRA-oBARBackbone=RoBERTa-large, Number of Parameters=355M, Evaluation Protocol=few-shot2024.10 | 91.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| JTT2026.04 | 91.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DFR2026.04 | 91.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NDT (−∞,∞)Ncomp=22026.03 | 91.44 | — | — | — | — | — | — | — | — | — | — | 91.4 | 91.4 | 0.965 | — | — | — | — | |
| Random + Feedback-ICLSelection Strategy=Random2024.06 | 91.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LoRA-nBARBackbone=RoBERTa-large, Number of Parameters=355M, Evaluation Protocol=few-shot2024.10 | 91.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NDT [0,∞)Ncomp=22026.03 | 91.4 | — | — | — | — | — | — | — | — | — | — | 91.4 | 91.4 | 0.965 | — | — | — | — | |
| SBERT + Feedback-ICLSelection Strategy=SBERT2024.06 | 91.32 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BaselineAttack=BadNet, Backbone=MobileBERT2025.12 | 91.27 | — | — | — | 100 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ICL-goldModel=GPT-J, Prompting=Direct, Training data access=true2022.12 | 91.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| LoRABackbone=RoBERTa-large, Number of Parameters=355M, Evaluation Protocol=few-shot2024.10 | 91.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ERM2026.04 | 91.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| NDT (−∞,∞)Ncomp=42026.03 | 91.09 | — | — | — | — | — | — | — | — | — | — | 91.1 | 91.1 | 0.964 | — | — | — | — | |
| NDT [0,∞)Ncomp=42026.03 | 91.06 | — | — | — | — | — | — | — | — | — | — | 91 | 91.1 | 0.985 | — | — | — | — | |
| SelfMixNoise Level=20%S2025.04 | 91.02 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BERT-baseBackbone=BERT-base, Implementation=Current Paper2025.01 | 91 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ELRNoise Level=20%S2025.04 | 90.98 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BaselineAttack=AddSent, Backbone=MobileBERT2025.12 | 90.94 | — | — | — | 100 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SelfMixNoise Level=20%A2025.04 | 90.89 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Vanilla Transformer2026.03 | 90.85 | — | — | — | — | — | — | — | — | — | — | 90.9 | 90.9 | 0.959 | — | — | — | — | |
| SCOUTAttack=BadNet, Backbone=MobileBERT2025.12 | 90.61 | — | — | — | 7.56 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DyGenNoise Level=20%A2025.04 | 90.25 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BaselineAttack=StyleBkd, Backbone=MobileBERT2025.12 | 90.22 | — | — | — | 99.45 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM252024.06 | 90.06 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DyGenNoise Level=20%S2025.04 | 89.87 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BaselineAttack=BadNet, Backbone=DistilBERT2025.12 | 89.84 | — | — | — | 96.17 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCOUTAttack=AddSent, Backbone=MobileBERT2025.12 | 89.84 | — | — | — | 0 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DyGenNoise Level=20%I2025.04 | 89.82 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCOUTAttack=BadNet, Backbone=DistilBERT2025.12 | 89.73 | — | — | — | 14.75 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Random2024.06 | 89.64 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BaselineAttack=StyleBkd, Backbone=DistilBERT2025.12 | 89.62 | — | — | — | 98.36 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MMR2024.06 | 89.45 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCENoise Level=20%S2025.04 | 89.45 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| STRIPAttack=BadNet, Backbone=MobileBERT2025.12 | 89.45 | — | — | — | 22.79 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ICL-goldModel=GPT-NeoX, Prompting=Channel, Training data access=true2022.12 | 89.4 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SunGenClassifier=DistilBERT, Training Protocol=Dedicated training techniques2023.06 | 89.38 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| STRIPAttack=StyleBkd, Backbone=DistilBERT2025.12 | 89.29 | — | — | — | 67.21 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ONIONAttack=AddSent, Backbone=MobileBERT2025.12 | 89.18 | — | — | — | 17.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BTUAttack=StyleBkd, Backbone=MobileBERT2025.12 | 89.07 | — | — | — | 64.48 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCENoise Level=20%A2025.04 | 89.03 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MDPAttack=BadNet, Backbone=DistilBERT2025.12 | 89.02 | — | — | — | 21.86 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCOUTAttack=StyleBkd, Backbone=DistilBERT2025.12 | 89.01 | — | — | — | 41.56 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BaselineAttack=AddSent, Backbone=DistilBERT2025.12 | 88.96 | — | — | — | 97.81 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCOUTAttack=StyleBkd, Backbone=MobileBERT2025.12 | 88.85 | — | — | — | 66.67 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ICL-goldModel=GPT-J, Prompting=Channel, Training data access=true2022.12 | 88.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BTUAttack=BadNet, Backbone=DistilBERT2025.12 | 88.74 | — | — | — | 33.88 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCOUTAttack=AddSent, Backbone=DistilBERT2025.12 | 88.74 | — | — | — | 26.78 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| K-Means2024.06 | 88.65 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ICL-goldModel=GPT-NeoX, Prompting=Direct, Training data access=true2022.12 | 88.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| BTUAttack=AddSent, Backbone=MobileBERT2025.12 | 88.52 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MDPAttack=StyleBkd, Backbone=DistilBERT2025.12 | 88.52 | — | — | — | 59.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| STRIPAttack=AddSent, Backbone=DistilBERT2025.12 | 88.41 | — | — | — | 30.05 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ONIONAttack=StyleBkd, Backbone=MobileBERT2025.12 | 88.41 | — | — | — | 76.5 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| MDPAttack=BadNet, Backbone=MobileBERT2025.12 | 88.3 | — | — | — | 28.42 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ONIONAttack=BadNet, Backbone=DistilBERT2025.12 | 88.19 | — | — | — | 29.51 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| SelfMixNoise Level=40%S2025.04 | 88.12 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ONIONAttack=BadNet, Backbone=MobileBERT2025.12 | 88.11 | — | — | — | 4.59 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ICL-goldPrompting Method=Channel, Backbone=GPT-3, Oracle=true2022.12 | 88.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ICL-randomModel=GPT-NeoX, Prompting=Channel, Training data access=true2022.12 | 88.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Deep-ThinkingIn-context learning setting=w/ dev set2023.05 | 88.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| STRIPAttack=AddSent, Backbone=MobileBERT2025.12 | 87.98 | — | — | — | 35.52 | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ReGenClassifier=DistilBERT, Training Protocol=Dedicated training techniques2023.06 | 87.84 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| Z-ICLModel=GPT-NeoX, Prompting=Direct, Training data access=false2022.12 | 87.8 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RobertaNoise Level=20%A2025.04 | 87.79 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — |