Membership Inference Attack on The PILE (train test)
66.5LossVanilla LoRA
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Vanilla LoRAModel=Qwen3-4B-Instruct-25072025.05 | 66.5 | 63.3 | 88.8 | 71.4 | 66.2 | 79.2 | 72.1 | |
| SHE-LoRAEncryption ratio (γ)=1‰, Model=Qwen3-4B-Instruct-25072025.05 | 89.7 | 86.9 | 93.9 | 90.8 | 90.3 | 90.5 | 89.9 | |
| SHE-LoRAEncryption ratio (γ)=1%, Model=Qwen3-4B-Instruct-25072025.05 | 92.4 | 90.7 | 95.2 | 93.8 | 93.4 | 91.6 | 93.1 | |
| SHE-LoRAEncryption ratio (γ)=10%, Model=Qwen3-4B-Instruct-25072025.05 | 92.4 | 90.7 | 95.2 | 93.8 | 93.4 | 91.6 | 93.1 | |
| SHE-LoRAEncryption ratio (γ)=5%, Model=Qwen3-4B-Instruct-25072025.05 | 93.2 | 92.1 | 95.5 | 94.5 | 94.1 | 93.1 | 93.8 | |
| SHE-LoRAEncryption ratio (γ)=20%, Model=Qwen3-4B-Instruct-25072025.05 | 93.2 | 93.5 | 95.6 | 95.4 | 95.1 | 94 | 94.8 | |
| BaseModel=Qwen3-4B-Instruct-25072025.05 | 94.1 | 95.4 | 96.1 | 96.1 | 95.2 | 95.5 | 95.7 |