Text Classification on Disaster
82.2AccuracyDP-FineTune
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DP-FineTuneModel=ROBERTA Large, Privacy Budget=82024.11 | 82.2 | 89.4 | |
| PrivateLoRAModel=Pythia 6.9B, Privacy Budget=82024.11 | 82.1 | 89.4 | |
| PrivateLoRAModel=ROBERTA Large, Privacy Budget=82024.11 | 81.8 | 89.3 | |
| PrivateLoRAModel=Vicuna 7B, Privacy Budget=82024.11 | 81.3 | 90.3 | |
| PrivateLoRAModel=Llama3-8B(Instruct), Privacy Budget=82024.11 | 80.8 | 90.2 | |
| DP-OPT (original)Model=GPT3 Davinci, Privacy Budget=82024.11 | 78.9 | 81.4 | |
| PromptDPSGDModel=ROBERTA Large, Privacy Budget=82024.11 | 77.8 | 68.6 | |
| 0-shotModel=GPT3 Davinci, Privacy Budget=02024.11 | 76.4 | 76.3 | |
| PrivateLoRAModel=Pythia 160M, Privacy Budget=82024.11 | 73.6 | 78.6 | |
| PromptPATEModel=Claude 2.1, Privacy Budget=< 0.32024.11 | 71 | 84.5 | |
| DP-ICLModel=GPT4 Turbo, Privacy Budget=82024.11 | 70.3 | 68.2 | |
| ICLModel=GPT3 Davinci, Privacy Budget=infinity2024.11 | 69 | 82.9 | |
| DP-OPT (local)Model=Vicuna 7B, Privacy Budget=82024.11 | 65.6 | 75.3 | |
| PromptPATEModel=GPT3 Babbage, Privacy Budget=82024.11 | 64.3 | 75 | |
| DP-FewShotGenModel=GPT3 Babbage, Privacy Budget=82024.11 | 59.2 | 64.2 | |
| PromptPATEModel=GPT3 Babbage, Privacy Budget=< 0.32024.11 | 58 | 69.6 | |
| DP-ICLModel=GPT3 Babbage, Privacy Budget=82024.11 | 50.6 | 62.6 |