Sentiment Classification on Mpqa
92.1AccuracyPromptPATE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PromptPATEModel=Claude 2.1, Privacy Budget=< 0.32024.11 | 92.1 | 84.5 | |
| DP-ICLModel=GPT4 Turbo, Privacy Budget=82024.11 | 90.4 | 68.2 | |
| ICLModel=GPT3 Davinci, Privacy Budget=infinity2024.11 | 88.8 | 82.9 | |
| DP-FineTuneModel=ROBERTA Large, Privacy Budget=82024.11 | 88.2 | 89.4 | |
| PrivateLoRAModel=Vicuna 7B, Privacy Budget=82024.11 | 87.8 | 90.3 | |
| PrivateLoRAModel=ROBERTA Large, Privacy Budget=82024.11 | 87.7 | 89.3 | |
| PrivateLoRAModel=Llama3-8B(Instruct), Privacy Budget=82024.11 | 87.3 | 90.2 | |
| PrivateLoRAModel=Pythia 6.9B, Privacy Budget=82024.11 | 87.2 | 89.4 | |
| DP-OPT (original)Model=GPT3 Davinci, Privacy Budget=82024.11 | 85.8 | 81.4 | |
| 0-shotModel=GPT3 Davinci, Privacy Budget=02024.11 | 84.5 | 76.3 | |
| PromptPATEModel=GPT3 Babbage, Privacy Budget=82024.11 | 83 | 75 | |
| DP-OPT (local)Model=Vicuna 7B, Privacy Budget=82024.11 | 80.7 | 75.3 | |
| DP-ICLModel=GPT3 Babbage, Privacy Budget=82024.11 | 80.6 | 62.6 | |
| PromptPATEModel=GPT3 Babbage, Privacy Budget=< 0.32024.11 | 79 | 69.6 | |
| RAEE (RB-L)Backbone=RoBERTa-Large2024.05 | 78.55 | — | |
| PrivateLoRAModel=Pythia 160M, Privacy Budget=82024.11 | 77.9 | 78.6 | |
| DeeBERT (RB-L)Backbone=RoBERTa-Large2024.05 | 75.95 | — | |
| RAEE (Gemma)Backbone=Gemma-7B2024.05 | 75.6 | — | |
| RAEE (Llama)Backbone=Llama-3-8B2024.05 | 75.05 | — | |
| DP-FewShotGenModel=GPT3 Babbage, Privacy Budget=82024.11 | 73.4 | 64.2 | |
| RB-LBackbone=RoBERTa-Large2024.05 | 67.6 | — | |
| AdaInfer (RB-L)Backbone=RoBERTa-Large2024.05 | 60.9 | — | |
| RAEE (T5-L)Backbone=T5-Large2024.05 | 55.65 | — | |
| SLEB (Llama)Backbone=Llama-3-8B2024.05 | 55.65 | — | |
| Llama-3-8BBackbone=Llama-3-8B2024.05 | 51.75 | — | |
| PromptDPSGDModel=ROBERTA Large, Privacy Budget=82024.11 | 50 | 68.6 | |
| Gemma-7BBackbone=Gemma-7B2024.05 | 50 | — | |
| HashEE (EB-L)Backbone=ElasticBERT-Large2024.05 | 50 | — | |
| SLEB (Gemma)Backbone=Gemma-7B2024.05 | 50 | — | |
| AdaInfer (Gemma)Backbone=Gemma-7B2024.05 | 50 | — | |
| AdaInfer (Llama)Backbone=Llama-3-8B2024.05 | 49.95 | — | |
| CALM (T5-L)Backbone=T5-Large2024.05 | 49.8 | — | |
| EB-LBackbone=ElasticBERT-Large2024.05 | 48.05 | — | |
| AdaInfer (T5-L)Backbone=T5-Large2024.05 | 46.3 | — | |
| T5-LBackbone=T5-Large2024.05 | 45.4 | — |