Membership Inference Attack on IMDB
86.7AUCProjRes
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ProjResTarget Model=Qwen2.5-14B2026.04 | 86.7 | 30.97 | |
| ProjResTarget Model=GPT2-Large2026.04 | 81.9 | 24.66 | |
| ProjResTarget Model=BERT-Base2026.04 | 80.7 | 9.65 | |
| FedMIATarget Model=BERT-Base2026.04 | 73.6 | — | |
| ProjResTarget Model=Llama3-8B2026.04 | 73.1 | 32.19 | |
| FTATarget Model=Qwen2.5-14B2026.04 | 66.2 | — | |
| FedMIATarget Model=GPT2-Large2026.04 | 65.7 | — | |
| CosineTarget Model=BERT-Base2026.04 | 62.7 | — | |
| Gradient-diffTarget Model=Qwen2.5-14B2026.04 | 59.2 | — | |
| FTATarget Model=GPT2-Large2026.04 | 59.2 | — | |
| Score-RatioTarget Model=BERT-Base2026.04 | 56.8 | — | |
| Score-RatioTarget Model=GPT2-Large2026.04 | 56.7 | — | |
| Fed-lossTarget Model=BERT-Base2026.04 | 56.1 | — | |
| Fed-lossTarget Model=GPT2-Large2026.04 | 55.9 | — | |
| FTATarget Model=Llama3-8B2026.04 | 55.3 | — | |
| Gradient-diffTarget Model=Llama3-8B2026.04 | 53.3 | — | |
| Score-DiffTarget Model=BERT-Base2026.04 | 53.2 | — | |
| CosineTarget Model=GPT2-Large2026.04 | 52.6 | — | |
| FedMIATarget Model=Llama3-8B2026.04 | 52.1 | — | |
| Score-DiffTarget Model=GPT2-Large2026.04 | 51.3 | — | |
| Gradient-diffTarget Model=BERT-Base2026.04 | 51 | — | |
| Gradient-diffTarget Model=GPT2-Large2026.04 | 50.9 | — | |
| Score-RatioTarget Model=Llama3-8B2026.04 | 49.8 | — | |
| Fed-lossTarget Model=Llama3-8B2026.04 | 49.7 | — | |
| Fed-lossTarget Model=Qwen2.5-14B2026.04 | 49 | — | |
| Score-RatioTarget Model=Qwen2.5-14B2026.04 | 49 | — | |
| FedMIATarget Model=Qwen2.5-14B2026.04 | 48.7 | — | |
| CosineTarget Model=Llama3-8B2026.04 | 48.4 | — | |
| Score-DiffTarget Model=Llama3-8B2026.04 | 48.4 | — | |
| Score-DiffTarget Model=Qwen2.5-14B2026.04 | 47.1 | — | |
| CosineTarget Model=Qwen2.5-14B2026.04 | 46.6 | — | |
| FTATarget Model=BERT-Base2026.04 | 45.9 | — |