Membership Inference on BookMIA CoT continuation prompts
0.967CRM-LR AUCMistral-7B-v0.3
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Mistral-7B-v0.3Layers=11, Extraction Protocol=signed PC1 projection, Across-layer PCA=false, Evaluation Protocol=5-fold CV2026.05 | 0.967 | 0.967 | 0.823 | |
| Llama-3.1-8BLayers=11, Extraction Protocol=signed PC1 projection, Across-layer PCA=false, Evaluation Protocol=5-fold CV2026.05 | 0.905 | 0.897 | 0.745 | |
| Qwen2.5-14B-InstLayers=16, Extraction Protocol=signed PC1 projection, Across-layer PCA=false, Evaluation Protocol=5-fold CV2026.05 | 0.844 | 0.751 | 0.683 |