Memorization Mitigation on Webster 2023
6SSCD OriginalOur Mitigation
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Our MitigationAdv. Steps=-, Adversarial Embeddings=false2025.07 | 6 | 2 | 67 | 0.3 | 0 | |
| WandaAdv. Steps=-, Adversarial Embeddings=false2025.07 | 9 | 10 | 45 | 0.29 | 0 | |
| Our MitigationAdv. Steps=50, Adversarial Embeddings=true2025.07 | 14 | 9 | 70 | 0.31 | 6 | |
| NeMoAdv. Steps=-, Adversarial Embeddings=false2025.07 | 23 | 20 | 71 | 0.32 | 6 | |
| WandaAdv. Steps=50, Adversarial Embeddings=true2025.07 | 70 | 19 | 84 | 0.31 | 53 | |
| No MitigationAdv. Steps=-, Adversarial Embeddings=false2025.07 | 77 | — | 98 | 0.31 | 100 | |
| NeMoAdv. Steps=50, Adversarial Embeddings=true2025.07 | 87 | 74 | 99 | 0.31 | 100 |