Membership Inference on WikiMIA Factoid QA
0.967AUCCRM-LTS
Evaluation results
| Method | Links | |
|---|---|---|
| CRM-LTSBackbone=Qwen2.5-14B-Inst, Probe=LR, Evaluation=5-fold CV, Samples=2502026.05 | 0.967 | |
| CRM-LTSBackbone=Qwen2.5-7B-Inst, Probe=LR, Evaluation=5-fold CV, Samples=2502026.05 | 0.955 | |
| CRM-LTSBackbone=Mistral-7B-Inst, Probe=LR, Evaluation=5-fold CV, Samples=2502026.05 | 0.867 | |
| CRM-LTSBackbone=Llama-3.1-8B, Probe=LR, Evaluation=5-fold CV, Samples=2502026.05 | 0.863 | |
| CRM-LTSBackbone=Llama-3.1-8B-Inst, Probe=LR, Evaluation=5-fold CV, Samples=2502026.05 | 0.862 | |
| CRM-LTSBackbone=Mistral-7B-v0.3, Probe=LR, Evaluation=5-fold CV, Samples=2502026.05 | 0.83 |