Membership Inference on BookMIA question-answering prompts
0.98CRM-LR AUCQwen2.5-14B-Inst
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Qwen2.5-14B-InstLayers=16, Extraction Protocol=signed PC1 projection, Across-layer PCA=false, Evaluation Protocol=5-fold CV2026.05 | 0.98 | 0.985 | 0.887 | — | |
| Llama-3.1-8BLayers=11, Extraction Protocol=signed PC1 projection, Across-layer PCA=false, Evaluation Protocol=5-fold CV2026.05 | 0.969 | 0.973 | 0.889 | — | |
| Mistral-7B-v0.3Layers=11, Extraction Protocol=signed PC1 projection, Across-layer PCA=false, Evaluation Protocol=5-fold CV2026.05 | 0.959 | 0.965 | 0.937 | — | |
| CRM-LTSBackbone=Qwen2.5-14B-Inst, Classifier=LR, Validation Protocol=5-fold CV, Prompting Strategy=QA prompts2026.05 | — | — | — | 0.98 | |
| CRM-LTSBackbone=Mistral-7B-v0.3, Classifier=LR, Validation Protocol=5-fold CV, Prompting Strategy=QA prompts2026.05 | — | — | — | 0.959 | |
| CRM-LTSBackbone=Llama-3.1-8B, Classifier=LR, Validation Protocol=5-fold CV, Prompting Strategy=QA prompts2026.05 | — | — | — | 0.969 |