# Subject Inference Attack on zsRE batch-edit tasks Source: [Subject Inference Attack on zsRE batch-edit tasks]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:01:14.608Z Evaluation of model performance on subject inference attacks conducted across various batch editing scenarios defined within the zsRE framework, measured by recall. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Subject inference attack | | Dataset (including any stated split) | zsRE batch-edit tasks | | Metric | Recall | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 36 of 36 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Recall](): Higher is better; unit: PERCENT. ## Recorded results | Method | Recall | Result date | Report paper | | --- | --- | --- | --- | | Ours (White-box) | 99 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 99 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 99 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 99 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 99 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 99 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 99 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 99 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 99 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 99 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 98 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 98 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 98 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 98 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 98 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 98 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 98 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 98 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 98 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Ours (White-box) | 98 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 96 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 96 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 92 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 92 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 90 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 84 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 82 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 74 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 70 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 69 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 68 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 61 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 58 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 55 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 44 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | | Gray-box | 43 | Not recorded | 698d5e62c97a0b3e3b5e3c5a | ### Ours (White-box) Recall: 99. Result ID: 6996db375698665ec427a950. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-J","N":"50","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 99. Result ID: 6996db375698665ec427a952. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-J","N":"50","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 99. Result ID: 6996db375698665ec427a954. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-J","N":"100","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 99. Result ID: 6996db375698665ec427a956. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-J","N":"100","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 99. Result ID: 6996db375698665ec427a95c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-Instruct","N":"50","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 99. Result ID: 6996db375698665ec427a95e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-Instruct","N":"50","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 99. Result ID: 6996db375698665ec427a960. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-Instruct","N":"100","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 99. Result ID: 6996db375698665ec427a962. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-Instruct","N":"100","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 99. Result ID: 6996db375698665ec427a96a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-Instruct","N":"50","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 99. Result ID: 6996db375698665ec427a96e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-Instruct","N":"100","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 98. Result ID: 6996db375698665ec427a94c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-J","N":"10","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Gray-box Recall: 98. Result ID: 6996db375698665ec427a94d. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-J","N":"10","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 98. Result ID: 6996db375698665ec427a94e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-J","N":"10","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Gray-box Recall: 98. Result ID: 6996db375698665ec427a94f. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-J","N":"10","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 98. Result ID: 6996db375698665ec427a958. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-Instruct","N":"10","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 98. Result ID: 6996db375698665ec427a95a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3-Instruct","N":"10","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 98. Result ID: 6996db375698665ec427a964. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-Instruct","N":"10","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 98. Result ID: 6996db375698665ec427a966. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-Instruct","N":"10","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 98. Result ID: 6996db375698665ec427a968. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-Instruct","N":"50","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Ours (White-box) Recall: 98. Result ID: 6996db375698665ec427a96c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-Instruct","N":"100","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Gray-box Recall: 96. Result ID: 6996db375698665ec427a953. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-J","N":"50","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Gray-box Recall: 96. Result ID: 6996db375698665ec427a957. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-J","N":"100","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Gray-box Recall: 92. Result ID: 6996db375698665ec427a951. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-J","N":"50","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Gray-box Recall: 92. Result ID: 6996db375698665ec427a955. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-J","N":"100","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Gray-box Recall: 90. Result ID: 6996db375698665ec427a965. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-Instruct","N":"10","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Gray-box Recall: 84. Result ID: 6996db375698665ec427a967. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-Instruct","N":"10","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Gray-box Recall: 82. Result ID: 6996db375698665ec427a959. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama-3-Instruct","N":"10","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Gray-box Recall: 74. Result ID: 6996db375698665ec427a95d. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama-3-Instruct","N":"50","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Gray-box Recall: 70. Result ID: 6996db375698665ec427a95b. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama-3-Instruct","N":"10","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Gray-box Recall: 69. Result ID: 6996db375698665ec427a961. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama-3-Instruct","N":"100","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Gray-box Recall: 68. Result ID: 6996db375698665ec427a969. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-Instruct","N":"50","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Gray-box Recall: 61. Result ID: 6996db375698665ec427a96b. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-Instruct","N":"50","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Gray-box Recall: 58. Result ID: 6996db375698665ec427a96d. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-Instruct","N":"100","Editing Method":"MEMIT"}. This record does not assert independent reproduction. ### Gray-box Recall: 55. Result ID: 6996db375698665ec427a96f. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen-2.5-Instruct","N":"100","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Gray-box Recall: 44. Result ID: 6996db375698665ec427a95f. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama-3-Instruct","N":"50","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. ### Gray-box Recall: 43. Result ID: 6996db375698665ec427a963. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama-3-Instruct","N":"100","Editing Method":"AlphaEdit"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.