List your company
ResearchFormerly WizWand

Information Extraction on MIT

95MIT-D ScorePrivateLoRA
69.93676.44382.9589.457Nov 2, 2024
Updated 8mo ago

Evaluation results

MethodLinks
PrivateLoRALLM Type=Open, Model=Vicuna 7B, T($)=0.52, Q($)=5.92, All($)=6.44, epsilon=82024.119574.4
PrivateLoRALLM Type=Open, Model=OpenLLaMA 13B, T($)=1.04, Q($)=6.21, All($)=7.25, epsilon=82024.119476.4
PrivateLoRALLM Type=Open, Model=Mixtral 8x7B, T($)=1.52, Q($)=9.47, All($)=10.99, epsilon=82024.119369.7
DP-FineTuneLLM Type=Open, Model=Pythia 1B, T($)=0.94, Q($)=0.5, All($)=1.44, epsilon=82024.1192.271.6
PrivateLoRALLM Type=Open, Model=Pythia 1B, T($)=0.08, Q($)=0.31, All($)=0.39, epsilon=82024.1190.268.8
PromptDPSGDGenLLM Type=Open, Model=Pythia 1B, T($)=0.17, Q($)=0.25, All($)=0.42, epsilon=82024.1189.869.1
DP-FewShotGenLLM Type=Closed, Model=GPT3 Davinci, T($)=0.42, Q($)=2.36, All($)=2.78, epsilon=82024.1180.664.1
PrivateLoRALLM Type=Open, Model=Pythia 410M, T($)=0.06, Q($)=0.5, All($)=0.56, epsilon=82024.1174.364.3
PromptPATEGenLLM Type=Open, Model=Vicuna 7B, T($)=0.52, Q($)=0.73, All($)=1.25, epsilon=82024.1174.141.7
PromptPATEGenLLM Type=Open, Model=OpenLLaMA 13B, T($)=3.11, Q($)=0.8, All($)=3.91, epsilon=82024.1170.933.4