Subject Inference Attack on zsRE batch-edit tasks
99RecallOurs (White-box)
Evaluation results
| Method | Links | |
|---|---|---|
| Ours (White-box)Model=GPT-J, N=50, Editing Method=MEMIT2026.02 | 99 | |
| Ours (White-box)Model=GPT-J, N=50, Editing Method=AlphaEdit2026.02 | 99 | |
| Ours (White-box)Model=GPT-J, N=100, Editing Method=MEMIT2026.02 | 99 | |
| Ours (White-box)Model=GPT-J, N=100, Editing Method=AlphaEdit2026.02 | 99 | |
| Ours (White-box)Model=Llama-3-Instruct, N=50, Editing Method=MEMIT2026.02 | 99 | |
| Ours (White-box)Model=Llama-3-Instruct, N=50, Editing Method=AlphaEdit2026.02 | 99 | |
| Ours (White-box)Model=Llama-3-Instruct, N=100, Editing Method=MEMIT2026.02 | 99 | |
| Ours (White-box)Model=Llama-3-Instruct, N=100, Editing Method=AlphaEdit2026.02 | 99 | |
| Ours (White-box)Model=Qwen-2.5-Instruct, N=50, Editing Method=AlphaEdit2026.02 | 99 | |
| Ours (White-box)Model=Qwen-2.5-Instruct, N=100, Editing Method=AlphaEdit2026.02 | 99 | |
| Ours (White-box)Model=GPT-J, N=10, Editing Method=MEMIT2026.02 | 98 | |
| Gray-boxModel=GPT-J, N=10, Editing Method=MEMIT2026.02 | 98 | |
| Ours (White-box)Model=GPT-J, N=10, Editing Method=AlphaEdit2026.02 | 98 | |
| Gray-boxModel=GPT-J, N=10, Editing Method=AlphaEdit2026.02 | 98 | |
| Ours (White-box)Model=Llama-3-Instruct, N=10, Editing Method=MEMIT2026.02 | 98 | |
| Ours (White-box)Model=Llama-3-Instruct, N=10, Editing Method=AlphaEdit2026.02 | 98 | |
| Ours (White-box)Model=Qwen-2.5-Instruct, N=10, Editing Method=MEMIT2026.02 | 98 | |
| Ours (White-box)Model=Qwen-2.5-Instruct, N=10, Editing Method=AlphaEdit2026.02 | 98 | |
| Ours (White-box)Model=Qwen-2.5-Instruct, N=50, Editing Method=MEMIT2026.02 | 98 | |
| Ours (White-box)Model=Qwen-2.5-Instruct, N=100, Editing Method=MEMIT2026.02 | 98 | |
| Gray-boxModel=GPT-J, N=50, Editing Method=AlphaEdit2026.02 | 96 | |
| Gray-boxModel=GPT-J, N=100, Editing Method=AlphaEdit2026.02 | 96 | |
| Gray-boxModel=GPT-J, N=50, Editing Method=MEMIT2026.02 | 92 | |
| Gray-boxModel=GPT-J, N=100, Editing Method=MEMIT2026.02 | 92 | |
| Gray-boxModel=Qwen-2.5-Instruct, N=10, Editing Method=MEMIT2026.02 | 90 | |
| Gray-boxModel=Qwen-2.5-Instruct, N=10, Editing Method=AlphaEdit2026.02 | 84 | |
| Gray-boxModel=Llama-3-Instruct, N=10, Editing Method=MEMIT2026.02 | 82 | |
| Gray-boxModel=Llama-3-Instruct, N=50, Editing Method=MEMIT2026.02 | 74 | |
| Gray-boxModel=Llama-3-Instruct, N=10, Editing Method=AlphaEdit2026.02 | 70 | |
| Gray-boxModel=Llama-3-Instruct, N=100, Editing Method=MEMIT2026.02 | 69 | |
| Gray-boxModel=Qwen-2.5-Instruct, N=50, Editing Method=MEMIT2026.02 | 68 | |
| Gray-boxModel=Qwen-2.5-Instruct, N=50, Editing Method=AlphaEdit2026.02 | 61 | |
| Gray-boxModel=Qwen-2.5-Instruct, N=100, Editing Method=MEMIT2026.02 | 58 | |
| Gray-boxModel=Qwen-2.5-Instruct, N=100, Editing Method=AlphaEdit2026.02 | 55 | |
| Gray-boxModel=Llama-3-Instruct, N=50, Editing Method=AlphaEdit2026.02 | 44 | |
| Gray-boxModel=Llama-3-Instruct, N=100, Editing Method=AlphaEdit2026.02 | 43 |