Prompt Recovery on Self-Instruct
34.71BLEU-1DORY
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DORYLLM=GPT-3.5-turbo2024.05 | 34.71 | 17.7 | 17.23 | 36.03 | 71.8 | |
| Jailbreak(max)LLM=GPT-3.5-turbo2024.05 | 27.92 | 10.98 | 13.05 | 25.79 | 65.4 | |
| DORYLLM=Llama2-7B Chat2024.05 | 27.5 | 11.18 | 14.38 | 27.47 | 65.59 | |
| Few-shotLLM=GPT-3.5-turbo2024.05 | 25.8 | 12.87 | 17 | 35.27 | 69.01 | |
| DORYLLM=ChatGLM2-6B2024.05 | 25.21 | 10.75 | 11.64 | 26.16 | 58.43 | |
| Few-shotLLM=Llama2-7B Chat2024.05 | 24.89 | 10.01 | 14.2 | 26.79 | 63.74 | |
| Inversion ModelLLM=ChatGLM2-6B2024.05 | 22.14 | 7.31 | 8.99 | 19.73 | 39.82 | |
| Inversion ModelLLM=Llama2-7B Chat2024.05 | 17.99 | 4.43 | 6.75 | 16.75 | 34.08 | |
| Jailbreak(max)LLM=ChatGLM2-6B2024.05 | 15.22 | 4.72 | 9.64 | 17.58 | 49.49 | |
| Few-shotLLM=ChatGLM2-6B2024.05 | 12.49 | 4.89 | 11.13 | 22.97 | 56.75 | |
| Jailbreak(mean)LLM=ChatGLM2-6B2024.05 | 12.43 | 4.41 | 9.43 | 15.48 | — | |
| Jailbreak(max)LLM=Llama2-7B Chat2024.05 | 11.06 | 4.09 | 13.34 | 19.89 | 59.66 | |
| Jailbreak(mean)LLM=GPT-3.5-turbo2024.05 | 10.73 | 3.52 | 9.55 | 14.55 | — | |
| Jailbreak(mean)LLM=Llama2-7B Chat2024.05 | 8.58 | 3.47 | 13.04 | 17.85 | — |