Subject Inference Attack on CounterFact batch-edit tasks
100RecallOurs (White-box)
Evaluation results
| Method | Links | |
|---|---|---|
| Ours (White-box)Model=Llama-3-Instruct, N=10, Editing Method=MEMIT2026.02 | 100 | |
| Ours (White-box)Model=Llama-3-Instruct, N=10, Editing Method=AlphaEdit2026.02 | 100 | |
| Ours (White-box)Model=Qwen-2.5-Instruct, N=10, Editing Method=MEMIT2026.02 | 100 | |
| Ours (White-box)Model=Qwen-2.5-Instruct, N=10, Editing Method=AlphaEdit2026.02 | 100 | |
| Ours (White-box)Model=Llama-3-Instruct, N=50, Editing Method=MEMIT2026.02 | 99 | |
| Ours (White-box)Model=Llama-3-Instruct, N=50, Editing Method=AlphaEdit2026.02 | 99 | |
| Ours (White-box)Model=Llama-3-Instruct, N=100, Editing Method=MEMIT2026.02 | 99 | |
| Ours (White-box)Model=Llama-3-Instruct, N=100, Editing Method=AlphaEdit2026.02 | 99 | |
| Ours (White-box)Model=GPT-J, N=10, Editing Method=MEMIT2026.02 | 98 | |
| Ours (White-box)Model=GPT-J, N=10, Editing Method=AlphaEdit2026.02 | 98 | |
| Gray-boxModel=GPT-J, N=10, Editing Method=MEMIT2026.02 | 96 | |
| Gray-boxModel=GPT-J, N=10, Editing Method=AlphaEdit2026.02 | 96 | |
| Ours (White-box)Model=GPT-J, N=50, Editing Method=MEMIT2026.02 | 96 | |
| Ours (White-box)Model=GPT-J, N=50, Editing Method=AlphaEdit2026.02 | 96 | |
| Ours (White-box)Model=GPT-J, N=100, Editing Method=AlphaEdit2026.02 | 96 | |
| Gray-boxModel=Llama-3-Instruct, N=10, Editing Method=MEMIT2026.02 | 96 | |
| Ours (White-box)Model=GPT-J, N=100, Editing Method=MEMIT2026.02 | 95 | |
| Ours (White-box)Model=Qwen-2.5-Instruct, N=100, Editing Method=AlphaEdit2026.02 | 95 | |
| Ours (White-box)Model=Qwen-2.5-Instruct, N=100, Editing Method=MEMIT2026.02 | 94 | |
| Ours (White-box)Model=Qwen-2.5-Instruct, N=50, Editing Method=MEMIT2026.02 | 93 | |
| Ours (White-box)Model=Qwen-2.5-Instruct, N=50, Editing Method=AlphaEdit2026.02 | 93 | |
| Gray-boxModel=GPT-J, N=100, Editing Method=MEMIT2026.02 | 88 | |
| Gray-boxModel=Qwen-2.5-Instruct, N=10, Editing Method=MEMIT2026.02 | 88 | |
| Gray-boxModel=GPT-J, N=50, Editing Method=MEMIT2026.02 | 87 | |
| Gray-boxModel=GPT-J, N=100, Editing Method=AlphaEdit2026.02 | 86 | |
| Gray-boxModel=GPT-J, N=50, Editing Method=AlphaEdit2026.02 | 85 | |
| Gray-boxModel=Qwen-2.5-Instruct, N=10, Editing Method=AlphaEdit2026.02 | 80 | |
| Gray-boxModel=Llama-3-Instruct, N=50, Editing Method=MEMIT2026.02 | 79 | |
| Gray-boxModel=Llama-3-Instruct, N=10, Editing Method=AlphaEdit2026.02 | 76 | |
| Gray-boxModel=Llama-3-Instruct, N=100, Editing Method=MEMIT2026.02 | 68 | |
| Gray-boxModel=Qwen-2.5-Instruct, N=50, Editing Method=MEMIT2026.02 | 63 | |
| Gray-boxModel=Qwen-2.5-Instruct, N=100, Editing Method=MEMIT2026.02 | 59 | |
| Gray-boxModel=Qwen-2.5-Instruct, N=50, Editing Method=AlphaEdit2026.02 | 54 | |
| Gray-boxModel=Llama-3-Instruct, N=50, Editing Method=AlphaEdit2026.02 | 52 | |
| Gray-boxModel=Qwen-2.5-Instruct, N=100, Editing Method=AlphaEdit2026.02 | 51 | |
| Gray-boxModel=Llama-3-Instruct, N=100, Editing Method=AlphaEdit2026.02 | 45 |