Membership Inference Attack on SST
1AUCProjRes
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ProjResTarget Model=BERT-Base2026.04 | 1 | 40.25 | |
| ProjResTarget Model=GPT2-Large2026.04 | 1 | 38.89 | |
| ProjResTarget Model=Llama3-8B2026.04 | 1 | 72.41 | |
| ProjResTarget Model=Qwen2.5-14B2026.04 | 1 | 71.23 | |
| FedMIATarget Model=GPT2-Large2026.04 | 0.72 | — | |
| FedMIATarget Model=BERT-Base2026.04 | 0.713 | — | |
| CosineTarget Model=GPT2-Large2026.04 | 0.709 | — | |
| Fed-lossTarget Model=BERT-Base2026.04 | 0.7 | — | |
| CosineTarget Model=BERT-Base2026.04 | 0.665 | — | |
| Fed-lossTarget Model=GPT2-Large2026.04 | 0.643 | — | |
| Gradient-diffTarget Model=BERT-Base2026.04 | 0.616 | — | |
| Score-RatioTarget Model=BERT-Base2026.04 | 0.612 | — | |
| Score-DiffTarget Model=BERT-Base2026.04 | 0.596 | — | |
| Score-RatioTarget Model=GPT2-Large2026.04 | 0.595 | — | |
| Score-DiffTarget Model=GPT2-Large2026.04 | 0.594 | — | |
| CosineTarget Model=Qwen2.5-14B2026.04 | 0.584 | — | |
| Fed-lossTarget Model=Qwen2.5-14B2026.04 | 0.582 | — | |
| Score-DiffTarget Model=Llama3-8B2026.04 | 0.58 | — | |
| Score-RatioTarget Model=Llama3-8B2026.04 | 0.579 | — | |
| Fed-lossTarget Model=Llama3-8B2026.04 | 0.57 | — | |
| Score-DiffTarget Model=Qwen2.5-14B2026.04 | 0.57 | — | |
| CosineTarget Model=Llama3-8B2026.04 | 0.567 | — | |
| Score-RatioTarget Model=Qwen2.5-14B2026.04 | 0.558 | — | |
| FedMIATarget Model=Qwen2.5-14B2026.04 | 0.557 | — | |
| Gradient-diffTarget Model=Qwen2.5-14B2026.04 | 0.557 | — | |
| Gradient-diffTarget Model=GPT2-Large2026.04 | 0.553 | — | |
| Gradient-diffTarget Model=Llama3-8B2026.04 | 0.536 | — | |
| FedMIATarget Model=Llama3-8B2026.04 | 0.494 | — | |
| FTATarget Model=Llama3-8B2026.04 | 0.462 | — | |
| FTATarget Model=Qwen2.5-14B2026.04 | 0.449 | — | |
| FTATarget Model=GPT2-Large2026.04 | 0.412 | — | |
| FTATarget Model=BERT-Base2026.04 | 0.385 | — |