SD
Benchmarks
TaskDatasetSOTA resultTrendResults
SD Inpainting 2.0 (cross-version transfer)
0.229IR
42
SD Inpainting 1.5
0.129IR Score
42
SD Other Class artistic styles 1.4 (test)
-1.4Preservation Drop
36
SD Target Class artistic styles 1.4 (test)
86Erased Accuracy
36
SD v1.5
99.37Accuracy
36
SD
14.8MAE
32
SD 1.5 (test)
0.831Average Similarity
28
SD
81.8POL
26
SD 2.1
0.997AUC
24
SD v1.4
97.4Accuracy
24
SD
0.123WAPE
24
SDXL
98.6Accuracy
22
SD Single-domain
94.04Accuracy
20
SD Original
100AUC
19
SD2 20 × 10
13.21Optimality Gap
17
SD2 30 x 10
692.26Objective Value
17
SD1 40 x 10
365.96Objective Value
17
SD Celebrity Erasure v2.1 (test)
88.76Accuracy (Retained)
16
SD LAION Lexica COCO-2017 GPT-4 1000 prompts 1.4 (Evaluation)
1AUC
16
SD14 to SD3 Cross-model transfer
21.98PSNR
16
SD Horizon 3
14.85MAE
15
SD concept prompts and COCO-30k v1.4 (test)
74.43Snoopy CS
15
SD Preserved Concepts Set 2.1
73.3CS Score
14
SD Van Gogh Erased Set 2.1
0.755CS Score
14
SD v2.1
100TPR @ 10^-6 FPR
14