Prompt Leakage Attack on MedQA
31.3ASR (500)SFT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SFTModel=Qwen-2.5-14B-Instruct2026.02 | 31.3 | 56.6 | 96 | 78.6 | 33.69 | |
| OPTILEAKModel=Qwen-2.5-14B-Instruct2026.02 | 30.7 | 60 | 97.3 | 82 | 30.6 | |
| OPTILEAKModel=Qwen-2.5-3B-Instruct2026.02 | 29.3 | 55.3 | 98.6 | 84 | 21.6 | |
| SFTModel=Qwen-2.5-3B-Instruct2026.02 | 27.3 | 53.3 | 98 | 80 | 26.37 | |
| SFTModel=Qwen-2.5-7B-Instruct2026.02 | 24 | 49.3 | 94.7 | 79.3 | 44.5 | |
| DPOModel=Qwen-2.5-14B-Instruct2026.02 | 24 | 46 | 94.7 | 68 | 43.83 | |
| BaseModel=Qwen-2.5-14B-Instruct2026.02 | 23.3 | 45.3 | 94.7 | — | 44.35 | |
| OPTILEAKModel=Qwen-2.5-7B-Instruct2026.02 | 22.7 | 48 | 96 | 81.3 | 40.49 | |
| BaseModel=Qwen-2.5-3B-Instruct2026.02 | 18 | 37.3 | 95.3 | — | 41.99 | |
| DPOModel=Qwen-2.5-3B-Instruct2026.02 | 18 | 38 | 95.3 | 48.7 | 41.86 | |
| BaseModel=Qwen-2.5-7B-Instruct2026.02 | 18 | 36 | 94 | — | 54.5 | |
| DPOModel=Qwen-2.5-7B-Instruct2026.02 | 17.3 | 37.3 | 94.7 | 55.3 | 52.67 | |
| OPTILEAKModel=Llama-3.1-8B-Instruct2026.02 | 12.6 | 48.7 | 98.7 | 79.3 | 28.31 | |
| SFTModel=Llama-3.1-8B-Instruct2026.02 | 8.7 | 43.3 | 98 | 74 | 30.43 | |
| DPOModel=Llama-3.1-8B-Instruct2026.02 | 8 | 28.7 | 92.7 | 74 | 54.86 | |
| BaseModel=Llama-3.1-8B-Instruct2026.02 | 5.3 | 27.3 | 92 | — | 60 |