Membership Inference on WikiMIA Summarization
0.964AUCCRM-LTS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| CRM-LTSBackbone=Qwen2.5-14B-Inst, Probe=LR, Evaluation=5-fold CV, Samples=2502026.05 | 0.964 | 0.016 | |
| CRM-LTSBackbone=Qwen2.5-7B-Inst, Probe=LR, Evaluation=5-fold CV, Samples=2502026.05 | 0.956 | 0.013 | |
| CRM-LTSBackbone=Mistral-7B-v0.3, Probe=LR, Evaluation=5-fold CV, Samples=2502026.05 | 0.902 | 0.078 | |
| CRM-LTSBackbone=Llama-3.1-8B, Probe=LR, Evaluation=5-fold CV, Samples=2502026.05 | 0.867 | 0.09 | |
| CRM-LTSBackbone=Mistral-7B-Inst, Probe=LR, Evaluation=5-fold CV, Samples=2502026.05 | 0.851 | 0.063 | |
| CRM-LTSBackbone=Llama-3.1-8B-Inst, Probe=LR, Evaluation=5-fold CV, Samples=2502026.05 | 0.815 | 0.013 |