Text Reconstruction from Gradients on SST-2
100ROUGE-1DAGER
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| DAGERModel=GPT-2_BASE, Batch size (B)=162024.05 | 100 | 94.6 | — | — | |
| DAGERModel=LLaMa-2 (7B), Batch size (B)=162024.05 | 100 | 100 | — | — | |
| DAGERModel=GPT-2_BASE, Batch size (B)=322024.05 | 100 | 93.4 | — | — | |
| DAGERModel=LLaMa-2 (7B), Batch size (B)=322024.05 | 100 | 99.9 | — | — | |
| DAGERModel=GPT-2_BASE, Batch size (B)=642024.05 | 100 | 85 | — | — | |
| DAGERModel=LLaMa-2 (7B), Batch size (B)=642024.05 | 99.9 | 99.9 | — | — | |
| DAGERModel=LLaMa-2 (7B), Batch size (B)=1282024.05 | 99.3 | 97.8 | — | — | |
| LAMPcosArchitecture=TinyBERT6, Batch size=1, Fine-tuned=false2022.02 | 91.6 | 58.2 | 79.7 | — | |
| LAMPL2+L1Architecture=TinyBERT6, Batch size=1, Fine-tuned=false2022.02 | 89.7 | 53.2 | 75.4 | — | |
| LAMPL2+L1Architecture=BERT-LARGE, Batch size=1, Fine-tuned=false2022.02 | 89.3 | 55.5 | 75.9 | — | |
| LAMPcosArchitecture=BERT-BASE, Batch size=1, Fine-tuned=false2022.02 | 88.8 | 56.9 | 77.7 | — | |
| LAMPL2+L1Architecture=BERT-BASE, Batch size=1, Fine-tuned=false2022.02 | 88.6 | 57.4 | 75.7 | — | |
| LAMPcosArchitecture=BERT-LARGE, Batch size=1, Fine-tuned=false2022.02 | 88.5 | 55.9 | 76.5 | — | |
| LAMPcosArchitecture=BERT-BASE, Batch size=1, Fine-tuned=true2022.02 | 87.6 | 54.1 | 76.1 | — | |
| TAGArchitecture=BERT-LARGE, Batch size=1, Fine-tuned=false2022.02 | 80.8 | 16.8 | 59.1 | — | |
| DLGArchitecture=BERT-LARGE, Batch size=1, Fine-tuned=false2022.02 | 78.4 | 18.1 | 59 | — | |
| TAGArchitecture=BERT-BASE, Batch size=1, Fine-tuned=false2022.02 | 75.6 | 18.9 | 57.4 | — | |
| DLGArchitecture=BERT-BASE, Batch size=1, Fine-tuned=false2022.02 | 65.4 | 17.7 | 54.2 | — | |
| TAGArchitecture=TinyBERT6, Batch size=1, Fine-tuned=false2022.02 | 43.5 | 9.4 | 40.9 | — | |
| DLGArchitecture=TinyBERT6, Batch size=1, Fine-tuned=false2022.02 | 42 | 5.4 | 39.6 | — | |
| LAMPL2+L1Architecture=BERT-BASE, Batch size=1, Fine-tuned=true2022.02 | 41.6 | 10.9 | 39.3 | — | |
| TAGArchitecture=BERT-BASE, Batch size=1, Fine-tuned=true2022.02 | 40 | 5.7 | 36.6 | — | |
| DLGArchitecture=BERT-BASE, Batch size=1, Fine-tuned=true2022.02 | 36 | 2.7 | 33.9 | — | |
| DAGERModel=GPT-2_BASE, Batch size (B)=1282024.05 | 14.6 | 4.3 | — | — | |
| DAGERModel=GPT-2, Hardware=RTX 5060, Batch Size (B)=12026.03 | — | — | — | 3 | |
| DAGERModel=GPT-2, Hardware=RTX 5060, Batch Size (B)=22026.03 | — | — | — | 4 | |
| DAGERModel=GPT-2, Hardware=RTX 5060, Batch Size (B)=42026.03 | — | — | — | 9 | |
| DAGERModel=GPT-2, Hardware=RTX 5060, Batch Size (B)=82026.03 | — | — | — | 18 | |
| DAGERModel=GPT-2, Hardware=RTX 5060, Batch Size (B)=162026.03 | — | — | — | 31 | |
| SOMPBeam Width (Bw)=4, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=12026.03 | — | — | — | 6 | |
| SOMPBeam Width (Bw)=4, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=92026.03 | — | — | — | 9 | |
| SOMPBeam Width (Bw)=4, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=42026.03 | — | — | — | 13 | |
| SOMPBeam Width (Bw)=4, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=82026.03 | — | — | — | 22 | |
| SOMPBeam Width (Bw)=4, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=162026.03 | — | — | — | 30 | |
| SOMPBeam Width (Bw)=8, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=12026.03 | — | — | — | 7 | |
| SOMPBeam Width (Bw)=8, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=22026.03 | — | — | — | 11 | |
| SOMPBeam Width (Bw)=8, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=42026.03 | — | — | — | 14 | |
| SOMPBeam Width (Bw)=8, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=82026.03 | — | — | — | 26 | |
| SOMPBeam Width (Bw)=8, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=162026.03 | — | — | — | 37 | |
| SOMPBeam Width (Bw)=16, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=12026.03 | — | — | — | 8 | |
| SOMPBeam Width (Bw)=16, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=22026.03 | — | — | — | 12 | |
| SOMPBeam Width (Bw)=16, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=42026.03 | — | — | — | 30 | |
| SOMPBeam Width (Bw)=16, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=82026.03 | — | — | — | 40 | |
| SOMPBeam Width (Bw)=16, Model=GPT-2, Hardware=RTX 5060, Batch Size (B)=162026.03 | — | — | — | 52 |