Reconstruction Privacy Evaluation on AlpacaEval (test)
99.95PrecisionElement-wise Sparsification
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Element-wise SparsificationModel=Qwen3-30B, Defense Level=12026.05 | 99.95 | 98.99 | 98 | |
| Gaussian Noise DefenseModel=Qwen3-30B, Defense Level=32026.05 | 99.73 | 97.59 | 95 | |
| Token-wise SparsificationModel=Qwen3-30B, Defense Level=22026.05 | 99.7 | 97.88 | 95 | |
| Gaussian Noise DefenseModel=Qwen3-30B, Defense Level=12026.05 | 99.39 | 98.98 | 98 | |
| Token-wise SparsificationModel=Qwen3-30B, Defense Level=12026.05 | 99.38 | 98.62 | 98 | |
| Gaussian Noise DefenseModel=Qwen3-30B, Defense Level=22026.05 | 99.34 | 98.9 | 97 | |
| Element-wise SparsificationModel=Qwen3-30B, Defense Level=22026.05 | 99.11 | 98.35 | 96 | |
| Token-wise SparsificationModel=Qwen3-30B, Defense Level=32026.05 | 98.65 | 96.44 | 94 | |
| Element-wise SparsificationModel=Qwen3-30B, Defense Level=32026.05 | 97.38 | 95.85 | 94 | |
| Gaussian Noise DefenseModel=Qwen3-30B, Defense Level=42026.05 | 96.92 | 92.36 | 93 | |
| PriPertModel=Qwen3-30B, Defense Level=12026.05 | 92.67 | 85.93 | 91 | |
| Token-wise SparsificationModel=Qwen3-30B, Defense Level=42026.05 | 86.54 | 79.52 | 85 | |
| Element-wise SparsificationModel=Qwen3-30B, Defense Level=42026.05 | 82.9 | 76.28 | 86 | |
| PriPertModel=Qwen3-30B, Defense Level=22026.05 | 74.03 | 67.64 | 72 | |
| PriPertModel=Qwen3-30B, Defense Level=32026.05 | 47.8 | 40.97 | 50 | |
| Token-wise SparsificationModel=Qwen3-30B, Defense Level=52026.05 | 46.52 | 38.6 | 69 | |
| Element-wise SparsificationModel=Qwen3-30B, Defense Level=52026.05 | 45.83 | 37.23 | 65 | |
| PriPertModel=Qwen3-30B, Defense Level=42026.05 | 26.34 | 20.55 | 29 | |
| PriPertModel=Qwen3-30B, Defense Level=52026.05 | 19.45 | 13.97 | 15 | |
| Gaussian Noise DefenseModel=Qwen3-30B, Defense Level=52026.05 | 8.65 | 6.63 | 11 |