Machine Unlearning on 32 target sequences (unlearning set)
2EL10UL
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| ULBackbone=Neo-2.7B, Epochs=6.22024.06 | 2 | 44.8 | 41.8 | |
| POPhBackbone=OPT-1.3B, Epochs=6.2, Label Type=hard labels2024.06 | 2.1 | 38.4 | 34.3 | |
| POPhBackbone=Neo-125M, Epochs=14.6, Label Type=hard labels2024.06 | 2.2 | 46.2 | 39.4 | |
| POPBackbone=Neo-2.7B, Epochs=6.2, Label Type=soft labels2024.06 | 2.2 | 45.9 | 43 | |
| POPBackbone=OPT-125M, Epochs=16.4, Label Type=soft labels2024.06 | 2.3 | 31.3 | 30.2 | |
| POPBackbone=OPT-1.3B, Epochs=7.8, Label Type=soft labels2024.06 | 2.3 | 35.6 | 34.4 | |
| ULBackbone=Neo-125M, Epochs=10.42024.06 | 2.3 | 45.7 | 39.5 | |
| POPBackbone=Neo-125M, Epochs=13.2, Label Type=soft labels2024.06 | 2.6 | 45.8 | 40.4 | |
| ULBackbone=OPT-125M, Epochs=8.42024.06 | 2.7 | 29.8 | 28.7 | |
| ULBackbone=OPT-1.3B, Epochs=5.62024.06 | 2.7 | 32 | 30.9 | |
| ULBackbone=OPT-2.7B, Epochs=6.22024.06 | 2.7 | 34.1 | 33.4 | |
| POPhBackbone=Neo-1.3B, Epochs=6.8, Label Type=hard labels2024.06 | 2.8 | 48.3 | 43.9 | |
| POPhBackbone=Neo-2.7B, Epochs=6.4, Label Type=hard labels2024.06 | 2.8 | 46.6 | 43.3 | |
| ULBackbone=Neo-1.3B, Epochs=5.42024.06 | 2.9 | 47.3 | 42.5 | |
| POPhBackbone=OPT-2.7B, Epochs=8.8, Label Type=hard labels2024.06 | 3.2 | 41.7 | 37.6 | |
| POPBackbone=Neo-1.3B, Epochs=6, Label Type=soft labels2024.06 | 3.2 | 48.8 | 44.4 | |
| POPhBackbone=OPT-125M, Epochs=8.4, Label Type=hard labels2024.06 | 3.5 | 29.8 | 22.8 | |
| POPBackbone=OPT-2.7B, Epochs=10.6, Label Type=soft labels2024.06 | 3.7 | 37.5 | 36.8 | |
| PretrainedBackbone=OPT-125M2024.06 | 6.2 | 53 | 40.5 | |
| PretrainedBackbone=OPT-1.3B2024.06 | 23.1 | 68.4 | 60.6 | |
| PretrainedBackbone=OPT-2.7B2024.06 | 25.3 | 70.2 | 63.1 | |
| PretrainedBackbone=Neo-125M2024.06 | 36.1 | 77.9 | 71.1 | |
| PretrainedBackbone=Neo-1.3B2024.06 | 66 | 92.1 | 88.3 | |
| PretrainedBackbone=Neo-2.7B2024.06 | 69.7 | 93.4 | 90.7 |