List your company

Membership Inference Attack on XSum (AUC and TPR@1% FPR variants)

0.742AUC (LOSS)GPT-2
0.571440.615720.660.70428Jan 17, 2026

Evaluation results

MethodLinks
GPT-2Fine-tuning method=Full fine-tuning2026.010.7420.7430.6820.9610.9270.9935.55.64.214.731.482.6
Llama-2Fine-tuning method=LoRA2026.010.5790.5760.5530.7990.7560.841.91.91.55.55.317.6
GPT-JFine-tuning method=LoRA2026.010.5780.5770.5510.7870.7610.861.821.56.25.619.7