Text reconstruction from gradients on Rotten Tomatoes
100ROUGE-1DAGER
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DAGERModel=GPT-2_BASE, Batch size (B)=162024.05 | 100 | 99.9 | — | |
| DAGERModel=LLaMa-2 (7B), Batch size (B)=162024.05 | 100 | 100 | — | |
| DAGERModel=LLaMa-2 (7B), Batch size (B)=322024.05 | 100 | 100 | — | |
| DAGERModel=LLaMa-2 (7B), Batch size (B)=1282024.05 | 99.7 | 99.7 | — | |
| DAGERBatch size=1, Target Model=BERTBase2026.04 | 99.4 | 99.1 | 98.8 | |
| DAGERModel=LLaMa-2 (7B), Batch size (B)=642024.05 | 97.9 | 97.8 | — | |
| DAGERModel=GPT-2_BASE, Batch size (B)=322024.05 | 97.8 | 97.8 | — | |
| DAGERBatch size=2, Target Model=BERTBase2026.04 | 94.7 | 92.2 | 85.4 | |
| FEDSPY-LLMBatch size=1, Target Model=BERTBase2026.04 | 91.6 | 82.6 | 81.9 | |
| FEDSPY-LLMBatch size=2, Target Model=BERTBase2026.04 | 89.8 | 78.6 | 63.1 | |
| LAMPL2+L1Architecture=BERT-LARGE, Batch size=1, Fine-tuned=false2022.02 | 77.6 | 16.6 | 45.8 | |
| FEDSPY-LLMBatch size=4, Target Model=BERTBase2026.04 | 77.2 | 63.6 | 59.5 | |
| LAMPcosArchitecture=TinyBERT6, Batch size=1, Fine-tuned=false2022.02 | 76 | 28.6 | 55.8 | |
| LAMPL2+L1Architecture=TinyBERT6, Batch size=1, Fine-tuned=false2022.02 | 74 | 19.4 | 46.7 | |
| TAGArchitecture=BERT-LARGE, Batch size=1, Fine-tuned=false2022.02 | 73.6 | 4.4 | 36.8 | |
| LAMPcosArchitecture=BERT-LARGE, Batch size=1, Fine-tuned=false2022.02 | 73.4 | 15.7 | 45.4 | |
| BGPBatch size=1, Target Model=BERTBase2026.04 | 71.5 | 20.4 | 48.7 | |
| DLGArchitecture=BERT-LARGE, Batch size=1, Fine-tuned=false2022.02 | 66.8 | 3.1 | 35.4 | |
| LAMPcosArchitecture=BERT-BASE, Batch size=1, Fine-tuned=false2022.02 | 64.7 | 16.3 | 43.1 | |
| FILMBatch size=1, Target Model=BERTBase2026.04 | 63.6 | 15.3 | 43.6 | |
| DAGERBatch size=4, Target Model=BERTBase2026.04 | 63.6 | 42.1 | 30.7 | |
| APRILBatch size=1, Target Model=BERTBase2026.04 | 63.5 | 15.1 | 43.2 | |
| LAMPcosArchitecture=BERT-BASE, Batch size=1, Fine-tuned=true2022.02 | 63.4 | 13.8 | 42.6 | |
| LAMPBatch size=1, Target Model=BERTBase2026.04 | 62.7 | 13.4 | 42 | |
| FEDSPY-LLMBatch size=8, Target Model=BERTBase2026.04 | 61.9 | 41.6 | 57.6 | |
| TAGArchitecture=BERT-BASE, Batch size=1, Fine-tuned=false2022.02 | 60.3 | 3.5 | 33.6 | |
| LAMPL2+L1Architecture=BERT-BASE, Batch size=1, Fine-tuned=false2022.02 | 51.4 | 10.2 | 34.3 | |
| BGPBatch size=2, Target Model=BERTBase2026.04 | 43.9 | 6.7 | 31.2 | |
| FILMBatch size=2, Target Model=BERTBase2026.04 | 39.6 | 5.2 | 28.3 | |
| DLGArchitecture=BERT-BASE, Batch size=1, Fine-tuned=false2022.02 | 38.6 | 1.4 | 26 | |
| Flex-LoRABatch Size (B)=42025.05 | 38.44 | 32.76 | — | |
| APRILBatch size=2, Target Model=BERTBase2026.04 | 38.2 | 5.6 | 28.4 | |
| LAMPBatch size=2, Target Model=BERTBase2026.04 | 37.8 | 6.1 | 28.2 | |
| Flex-LoRA-DPBatch Size (B)=42025.05 | 36.74 | 31.28 | — | |
| DAGERBatch size=8, Target Model=BERTBase2026.04 | 32.3 | 6.8 | 6.8 | |
| MaskCryptBatch Size (B)=42025.05 | 31.65 | 25.11 | — | |
| TAGBatch size=1, Target Model=BERTBase2026.04 | 31.2 | 2.4 | 19.7 | |
| FILMBatch size=4, Target Model=BERTBase2026.04 | 30.5 | 2.5 | 23.1 | |
| BGPBatch size=4, Target Model=BERTBase2026.04 | 29.3 | 3.3 | 23.8 | |
| APRILBatch size=4, Target Model=BERTBase2026.04 | 27.7 | 2.3 | 20.7 | |
| TAGBatch size=4, Target Model=BERTBase2026.04 | 27.4 | 0.8 | 19.7 | |
| TAGArchitecture=BERT-BASE, Batch size=1, Fine-tuned=true2022.02 | 26.7 | 0.9 | 18.2 | |
| TAGBatch size=2, Target Model=BERTBase2026.04 | 26.4 | 1 | 18.7 | |
| TAGArchitecture=TinyBERT6, Batch size=1, Fine-tuned=false2022.02 | 25.8 | 1.5 | 20.2 | |
| LAMPBatch size=4, Target Model=BERTBase2026.04 | 24.1 | 2.2 | 19.6 | |
| BGPBatch size=8, Target Model=BERTBase2026.04 | 23.1 | 1.6 | 19.3 | |
| FILMBatch size=8, Target Model=BERTBase2026.04 | 22.3 | 1.2 | 18.3 | |
| TAGBatch size=8, Target Model=BERTBase2026.04 | 22.1 | 0.7 | 18.1 | |
| APRILBatch size=8, Target Model=BERTBase2026.04 | 21.9 | 1 | 18.4 | |
| DLGArchitecture=TinyBERT6, Batch size=1, Fine-tuned=false2022.02 | 20.4 | 1.1 | 17.7 | |
| LAMPBatch size=8, Target Model=BERTBase2026.04 | 20.2 | 0.6 | 17.3 | |
| DLGArchitecture=BERT-BASE, Batch size=1, Fine-tuned=true2022.02 | 20.1 | 0.4 | 15.2 | |
| DLGBatch size=1, Target Model=BERTBase2026.04 | 19.7 | 0.4 | 14.9 | |
| DLGBatch size=8, Target Model=BERTBase2026.04 | 19.6 | 0.3 | 16.5 | |
| DLGBatch size=2, Target Model=BERTBase2026.04 | 18.5 | 0.6 | 15 | |
| DLGBatch size=4, Target Model=BERTBase2026.04 | 18.3 | 0.4 | 15.2 | |
| LAMPL2+L1Architecture=BERT-BASE, Batch size=1, Fine-tuned=true2022.02 | 17.2 | 1 | 14.7 | |
| MaskCryptBatch Size (B)=82025.05 | 6.09 | 3.27 | — | |
| Flex-LoRABatch Size (B)=82025.05 | 3.76 | 2.12 | — | |
| Flex-LoRA-DPBatch Size (B)=82025.05 | 3.76 | 2.02 | — | |
| DAGERModel=GPT-2_BASE, Batch size (B)=642024.05 | 2.8 | 1.1 | — | |
| DAGERModel=GPT-2_BASE, Batch size (B)=1282024.05 | 0 | 0 | — | |
| SHE-LoRABatch Size (B)=42025.05 | 0 | 0 | — | |
| SHE-LoRABatch Size (B)=82025.05 | 0 | 0 | — | |
| Flex-LoRABatch Size (B)=162025.05 | 0 | 0 | — | |
| Flex-LoRA-DPBatch Size (B)=162025.05 | 0 | 0 | — | |
| MaskCryptBatch Size (B)=162025.05 | 0 | 0 | — | |
| SHE-LoRABatch Size (B)=162025.05 | 0 | 0 | — |