Memorization Mitigation on Pythia 2.8B
5.94Memory Usage (%)BalancedSub
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BalancedSubModel Backbone=Pythia 2.8B2026.02 | 5.94 | 31.52 | 2,068.77 | |
| DurableModel Backbone=Pythia 2.8B2026.02 | 6.93 | 35.49 | 17.44 | |
| GSSModel Backbone=Pythia 2.8B2026.02 | 6.93 | 28.26 | 0.16 | |
| Durable-aggModel Backbone=Pythia 2.8B2026.02 | 7.52 | 32.35 | 231.43 | |
| SubnetModel Backbone=Pythia 2.8B2026.02 | 8.01 | 32.2 | 48.75 | |
| SlimModel Backbone=Pythia 2.8B2026.02 | 14.46 | 23.41 | 1.96 | |
| ActModel Backbone=Pythia 2.8B2026.02 | 14.46 | 24.43 | 13.01 | |
| HCModel Backbone=Pythia 2.8B2026.02 | 44.55 | 21.35 | 2.25 | |
| BaselineModel Backbone=Pythia 2.8B2026.02 | 52.87 | 21.75 | — |