Prompt recovery attack on zsRE (test)
34Top-1 AccuracyAlphaEdit
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| AlphaEditModel=Llama-3-Instruct, N=102026.02 | 34 | 68 | 84 | 84 | |
| AlphaEditModel=GPT-J, N=502026.02 | 33 | 67 | 88 | 83 | |
| AlphaEditModel=GPT-J, N=1002026.02 | 31 | 66 | 87 | 83 | |
| AlphaEditModel=Llama-3-Instruct, N=502026.02 | 31 | 55 | 76 | 83 | |
| AlphaEditModel=GPT-J, N=102026.02 | 28 | 62 | 88 | 84 | |
| AlphaEditModel=Llama-3-Instruct, N=1002026.02 | 25 | 51 | 71 | 83 | |
| AlphaEditModel=Qwen-2.5-Instruct, N=102026.02 | 12 | 34 | 54 | 81 | |
| AlphaEditModel=Qwen-2.5-Instruct, N=502026.02 | 8 | 31 | 57 | 78 | |
| AlphaEditModel=Qwen-2.5-Instruct, N=1002026.02 | 7 | 21 | 42 | 77 |