Information Extraction on MIT
95MIT-D ScorePrivateLoRA
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PrivateLoRALLM Type=Open, Model=Vicuna 7B, T($)=0.52, Q($)=5.92, All($)=6.44, epsilon=82024.11 | 95 | 74.4 | |
| PrivateLoRALLM Type=Open, Model=OpenLLaMA 13B, T($)=1.04, Q($)=6.21, All($)=7.25, epsilon=82024.11 | 94 | 76.4 | |
| PrivateLoRALLM Type=Open, Model=Mixtral 8x7B, T($)=1.52, Q($)=9.47, All($)=10.99, epsilon=82024.11 | 93 | 69.7 | |
| DP-FineTuneLLM Type=Open, Model=Pythia 1B, T($)=0.94, Q($)=0.5, All($)=1.44, epsilon=82024.11 | 92.2 | 71.6 | |
| PrivateLoRALLM Type=Open, Model=Pythia 1B, T($)=0.08, Q($)=0.31, All($)=0.39, epsilon=82024.11 | 90.2 | 68.8 | |
| PromptDPSGDGenLLM Type=Open, Model=Pythia 1B, T($)=0.17, Q($)=0.25, All($)=0.42, epsilon=82024.11 | 89.8 | 69.1 | |
| DP-FewShotGenLLM Type=Closed, Model=GPT3 Davinci, T($)=0.42, Q($)=2.36, All($)=2.78, epsilon=82024.11 | 80.6 | 64.1 | |
| PrivateLoRALLM Type=Open, Model=Pythia 410M, T($)=0.06, Q($)=0.5, All($)=0.56, epsilon=82024.11 | 74.3 | 64.3 | |
| PromptPATEGenLLM Type=Open, Model=Vicuna 7B, T($)=0.52, Q($)=0.73, All($)=1.25, epsilon=82024.11 | 74.1 | 41.7 | |
| PromptPATEGenLLM Type=Open, Model=OpenLLaMA 13B, T($)=3.11, Q($)=0.8, All($)=3.91, epsilon=82024.11 | 70.9 | 33.4 |