Categories Companies Research

Loading the SOTA2 catalog…

Explore

Categories Companies Research

Contribute

Join SOTA2 Contact

SOTA2

© 2026 SOTA2

Build in Bellevue, USA

WizWand is now SOTA2 Research

Papers Benchmarks Datasets Tasks

Membership Inference Attack research benchmarks – Page 10 · SOTA2 Research

Membership Inference Attack

Benchmarks

Dataset NameSOTA MethodSort

Dataset NameSOTA methodMetricTrendResultsLast Updated

0.8AUC

8

Feb 26, 2026

CIFAR-10 10% Adversarial deletion (test)

0.745AUC

8

Feb 26, 2026

CIFAR-10 10% Class-specific deletion (test)

0.678AUC

8

Feb 26, 2026

CIFAR-10 10% Random deletion (test)

0.612AUC

8

Feb 26, 2026

Noise as a Probe

0.892AUC

8

Feb 26, 2026

69.16Balanced Accuracy

8

Feb 26, 2026

Blog Authorship Corpus (test)

86.4Accuracy

7

Jul 7, 2026

N-GRAM COVERAGE ATTACK

85N-Gram Coverage (Cov.)

7

Apr 28, 2026

ImageNet 1K V2 (train)

85.73ASR

7

Apr 27, 2026

Flickr30K (fine-tuned)

72.23AUC

7

Apr 27, 2026

MS-COCO fine-tuned 2017 (val)

94.24AUC

7

Apr 27, 2026

Pokémon lambdalabs blip-captions (fine-tuned)

97.01AUC

7

Apr 27, 2026

C4 Vocabulary Size 200,000

Vocabulary Overlap

0.771AUC

7

Mar 10, 2026

C4 Vocabulary Size: 170,000

Vocabulary Overlap

0.761AUC

7

Mar 10, 2026

C4 Vocabulary Size 140,000

Vocabulary Overlap

0.736AUC

7

Mar 10, 2026

C4 Vocabulary Size: 110,000

Vocabulary Overlap

71.8AUC

7

Mar 10, 2026

C4 Vocabulary Size: 80,000

Vocabulary Overlap

0.693AUC

7

Mar 10, 2026

Dolma3 arXiv (Paraphrased) v1 (test)

90.3AUROC

7

Feb 26, 2026

Dolma3 arXiv Original v1 (test)

0.924AUROC

7

Feb 26, 2026

WikiMIA Hard (Paraphrased) 2024 v1 (test)

58.4AUROC

7

Feb 26, 2026

WikiMIA Hard Original 2024 v1 (test)

60.6AUROC

7

Feb 26, 2026

BookMIA Paraphrased v1 (test)

74.5AUROC

7

Feb 26, 2026

BookMIA Original v1 (test)

78.4AUROC

7

Feb 26, 2026

S1 Distillation Gemini-2.0-flash

0.852AUROC

7

Feb 26, 2026

S1.1 Distillation Deepseek-R1

98.4AUROC

7

Feb 26, 2026

Page 10 of 16

Popular datasets

CIFAR MIMIR ImageNet WikiMIA VL-MIA

Follow for updates

Join SOTA2 Contact