Prompt Leakage Attack on FinanceBench
88ASR500SFT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SFTModel=Qwen-2.5-3B-Instruct2026.02 | 88 | 90 | 100 | 100 | 20.81 | |
| OPTILEAKModel=Qwen-2.5-3B-Instruct2026.02 | 88 | 90 | 100 | 100 | 19.29 | |
| OPTILEAKModel=Qwen-2.5-7B-Instruct2026.02 | 86 | 92 | 96 | 96 | 66.87 | |
| OPTILEAKModel=Qwen-2.5-14B-Instruct2026.02 | 84 | 88 | 98 | 98 | 36.31 | |
| SFTModel=Qwen-2.5-14B-Instruct2026.02 | 78 | 88 | 98 | 96 | 39.49 | |
| SFTModel=Qwen-2.5-7B-Instruct2026.02 | 76 | 82 | 96 | 94 | 69.63 | |
| OPTILEAKModel=Llama-3.1-8B-Instruct2026.02 | 64 | 86 | 100 | 98 | 33.89 | |
| SFTModel=Llama-3.1-8B-Instruct2026.02 | 62 | 86 | 98 | 98 | 37.91 | |
| BaseModel=Qwen-2.5-7B-Instruct2026.02 | 6 | 6 | 66 | — | 259.65 | |
| DPOModel=Qwen-2.5-7B-Instruct2026.02 | 6 | 6 | 72 | 84 | 246.38 | |
| BaseModel=Qwen-2.5-14B-Instruct2026.02 | 4 | 4 | 64 | — | 214.19 | |
| DPOModel=Qwen-2.5-14B-Instruct2026.02 | 4 | 4 | 64 | 62 | 213.46 | |
| BaseModel=Qwen-2.5-3B-Instruct2026.02 | 2 | 2 | 54 | — | 240.81 | |
| DPOModel=Qwen-2.5-3B-Instruct2026.02 | 2 | 2 | 56 | 68 | 238.81 | |
| BaseModel=Llama-3.1-8B-Instruct2026.02 | 0 | 0 | 60 | — | 286.52 | |
| DPOModel=Llama-3.1-8B-Instruct2026.02 | 0 | 2 | 66 | 88 | 248.69 |