Memorization Detection on Stable Diffusion v1.4
0.9995AUCBroken Memories
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Broken MemoriesNum of Seeds=82026.05 | 0.9995 | 99.2 | — | |
| M(xT, c)n (number of generations)=4, Time (sec.)=3.42026.01 | 0.999 | 98.4 | — | |
| Broken MemoriesNum of Seeds=42026.05 | 0.9983 | 98 | — | |
| Jeon et al. (2025)n (number of generations)=4, Time (sec.)=19.42026.01 | 0.998 | 98.2 | — | |
| E[Delta s_theta_tilde]baseline=less-trained model (theta_tilde), type=score-difference2026.05 | 0.998 | 98.8 | — | |
| Wen et al.Num of Seeds=82026.05 | 0.9977 | 98.8 | — | |
| E[Delta h_phi]baseline=null-prompt (phi), type=curvature-difference2026.05 | 0.997 | 98.2 | — | |
| E[Delta s_phi]baseline=null-prompt (phi), type=score-difference2026.05 | 0.997 | 98.2 | — | |
| Wen et al.Num of Seeds=42026.05 | 0.9959 | 98.2 | — | |
| M(xT, c)n (number of generations)=1, Time (sec.)=1.12026.01 | 0.994 | 93.5 | — | |
| Wen et al. (2024)n (number of generations)=4, Time (sec.)=1.22026.01 | 0.992 | 94.4 | — | |
| E[Delta h_theta_tilde]baseline=less-trained model (theta_tilde), type=curvature-difference2026.05 | 0.989 | 90 | — | |
| Jeon et al. (2025)n (number of generations)=1, Time (sec.)=5.42026.01 | 0.987 | 90.8 | — | |
| Representation-based Memorization DetectionPrompt Free?=Yes, Time=0.0672025.12 | 0.987 | — | 0.961 | |
| Wen+24Prompt Free?=No, Time=0.1342025.12 | 0.986 | — | 0.961 | |
| Broken MemoriesNum of Seeds=12026.05 | 0.9858 | 90.4 | — | |
| Wen et al.Num of Seeds=12026.05 | 0.9831 | 91.4 | — | |
| Wen et al. (2024)n (number of generations)=1, Time (sec.)=0.42026.01 | 0.976 | 89.6 | — | |
| Ren et al.Num of Seeds=12026.05 | 0.966 | 62.2 | — | |
| Hin+24Prompt Free?=No, Time=0.0092025.12 | 0.957 | — | 0.5 | |
| Ros+25Prompt Free?=Yes, Time=0.5452025.12 | 0.956 | — | 0.915 | |
| Ren et al.Num of Seeds=82026.05 | 0.9395 | 69.8 | — | |
| Ren et al.Num of Seeds=42026.05 | 0.9383 | 69.4 | — | |
| E[BE-attention]type=Attention-based baseline2026.05 | 0.886 | 39 | — | |
| E[diag(-H_theta(xt, c))]type=Raw curvature baseline2026.05 | 0.861 | 8.2 | — | |
| Ren et al. (2024)n (number of generations)=1, Time (sec.)=0.052026.01 | 0.846 | 11.6 | — | |
| Ren et al. (2024)n (number of generations)=4, Time (sec.)=0.052026.01 | 0.839 | 13 | — | |
| Car+23Prompt Free?=No, Time=3.7242025.12 | 0.498 | — | 0.02 |