Question Answering on PFL-DocVQA (test)
0.702ROUGE-1DP-FineTune
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DP-FineTuneLLM Type=Open, Model=Pythia 1B, Epsilon=82024.11 | 0.702 | 0.557 | 0.783 | 137.06 | 1.32 | 138.38 | |
| PrivateLoRALLM Type=Open, Model=Pythia 6.9B, Epsilon=82024.11 | 0.644 | 0.479 | 0.733 | 293.25 | 5.8 | 299.05 | |
| PrivateLoRALLM Type=Open, Model=Pythia 1B, Epsilon=82024.11 | 0.642 | 0.432 | 0.734 | 44.16 | 1.28 | 45.44 | |
| PrivateLoRALLM Type=Open, Model=OpenLLaMA 13B, Epsilon=82024.11 | 0.631 | 0.222 | 0.707 | 358.8 | 9.02 | 367.82 | |
| DP-ICLLLM Type=Open, Model=OpenLLaMA 13B, Epsilon=82024.11 | 0.607 | 0.239 | 0.525 | 0 | 641.32 | 641.32 | |
| PromptDPSGDGenLLM Type=Open, Model=Pythia 1B, Epsilon=82024.11 | 0.573 | 0.401 | 0.668 | 37.26 | 0.96 | 38.22 | |
| PromptPATEGenLLM Type=Open, Model=Vicuna 7B, Epsilon=82024.11 | 0.317 | 0.266 | 0.357 | 2.28 | 0.57 | 2.85 |