Membership Inference Attack on RWKU MIA Set
7.1544FM ScoreRWKU
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RWKUFinetuning Strategy=GA+KL, Backbone=Llama-2-7b-chat2026.04 | 7.1544 | 2.434 | |
| RWKUFinetuning Strategy=GA+GD, Backbone=Llama-2-7b-chat2026.04 | 7.1499 | 2.4194 | |
| RWKUFinetuning Strategy=GA, Backbone=Llama-2-7b-chat2026.04 | 3.1075 | 2.4128 | |
| ELUDeFinetuning Strategy=NPO, Backbone=Llama-2-7b-chat2026.04 | 2.1874 | 2.2383 | |
| RWKUFinetuning Strategy=NPO, Backbone=Llama-2-7b-chat2026.04 | 2.1667 | 2.2093 | |
| MAGEFinetuning Strategy=NPO, Backbone=Llama-2-7b-chat2026.04 | 2.1054 | 2.177 | |
| MAGEFinetuning Strategy=GA+GD, Backbone=Llama-2-7b-chat2026.04 | 2.0119 | 2.1121 | |
| MAGEFinetuning Strategy=GA+KL, Backbone=Llama-2-7b-chat2026.04 | 2.0046 | 2.1068 | |
| ELUDeFinetuning Strategy=GA, Backbone=Llama-2-7b-chat2026.04 | 1.9933 | 2.1057 | |
| MAGEFinetuning Strategy=GA, Backbone=Llama-2-7b-chat2026.04 | 1.9885 | 2.1016 | |
| ELUDeFinetuning Strategy=GA+KL, Backbone=Llama-2-7b-chat2026.04 | 1.9768 | 2.0909 | |
| ELUDeFinetuning Strategy=GA+GD, Backbone=Llama-2-7b-chat2026.04 | 1.96 | 2.0716 | |
| DirectQAFinetuning Strategy=GA+KL, Backbone=Llama-2-7b-chat2026.04 | 1.9559 | 2.0635 | |
| DirectQAFinetuning Strategy=GA, Backbone=Llama-2-7b-chat2026.04 | 1.9286 | 2.0572 | |
| DirectQAFinetuning Strategy=NPO, Backbone=Llama-2-7b-chat2026.04 | 1.9178 | 2.0494 | |
| BeforeBackbone=Llama-2-7b-chat2026.04 | 1.9104 | 2.0433 | |
| DirectQAFinetuning Strategy=GA+GD, Backbone=Llama-2-7b-chat2026.04 | 1.8484 | 1.9758 |