Continual Unlearning on CIFAR-100
91.38Retention Accuracy (RA)FT
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| FTBackbone=ViT-L/14, Step=Step 52026.05 | 91.38 | — | — | — | — | — | 80 | 61 | 89 | 76 | 97 | 90.84 | 7.6 | 54.6 | |
| FTBackbone=ViT-L/14, Step=Step 42026.05 | 91.18 | — | — | — | — | — | 71 | 69 | 87 | 88 | 97 | 90.74 | — | — | |
| FTBackbone=ViT-L/14, Step=Step 32026.05 | 90.73 | — | — | — | — | — | 74 | 75 | 89 | 91 | 98 | 90.46 | — | — | |
| FTBackbone=ViT-L/14, Step=Step 22026.05 | 90.12 | — | — | — | — | — | 69 | 80 | 90 | 94 | 98 | 89.92 | — | — | |
| FTBackbone=ViT-L/14, Step=Step 12026.05 | 89.55 | — | — | — | — | — | 87 | 88 | 89 | 93 | 96 | 89.6 | — | — | |
| OriginalBackbone=ViT-L/162026.04 | 86.08 | 86.43 | 23.44 | — | — | — | — | — | — | — | — | — | — | — | |
| OriginalBackbone=ResNet-502026.04 | 85.31 | 85.63 | 24.6 | — | — | — | — | — | — | — | — | — | — | — | |
| FTBackbone=ViT-B/32, Step=Step 32026.05 | 85.27 | — | — | — | — | — | 66 | 53 | 79 | 91 | 96 | 84.86 | — | — | |
| FTBackbone=ViT-B/32, Step=Step 52026.05 | 84.98 | — | — | — | — | — | 51 | 48 | 73 | 73 | 96 | 84.14 | 10.2 | 59.78 | |
| FTBackbone=ViT-B/32, Step=Step 42026.05 | 84.93 | — | — | — | — | — | 58 | 51 | 77 | 87 | 96 | 84.37 | — | — | |
| FTBackbone=ViT-B/32, Step=Step 22026.05 | 84.62 | — | — | — | — | — | 65 | 60 | 82 | 89 | 96 | 84.31 | — | — | |
| FTBackbone=ViT-B/32, Step=Step 12026.05 | 83.17 | — | — | — | — | — | 70 | 74 | 85 | 90 | 95 | 83.15 | — | — | |
| GPPUBackbone=ViT-L/162026.04 | 82.34 | 8.91 | 89.27 | 2.14 | 61.44 | 35.12 | — | — | — | — | — | — | — | — | |
| PBUBackbone=ViT-L/162026.04 | 81.22 | 10.73 | 85.42 | 6.14 | 63.22 | 288.5 | — | — | — | — | — | — | — | — | |
| GPPUBackbone=ResNet-502026.04 | 80.42 | 9.37 | 88.52 | 2.47 | 60.92 | 32.81 | — | — | — | — | — | — | — | — | |
| PBUBackbone=ResNet-502026.04 | 79.34 | 11.92 | 83.57 | 6.82 | 62.18 | 255.4 | — | — | — | — | — | — | — | — | |
| SalUnBackbone=ViT-L/162026.04 | 77.5 | 22.5 | 78 | 22 | 64.15 | 312 | — | — | — | — | — | — | — | — | |
| SalUnBackbone=ResNet-502026.04 | 76.1 | 22 | 76.5 | 23 | 63.3 | 281 | — | — | — | — | — | — | — | — | |
| OriginalBackbone=ViT-L/14, Step=Step 02026.05 | 74.88 | — | — | — | — | — | 90 | 82 | 71 | 91 | 62 | 75.1 | — | — | |
| BTBackbone=ViT-L/162026.04 | 74.11 | 45.62 | 69.11 | 38.11 | 65.12 | 449.3 | — | — | — | — | — | — | — | — | |
| BTBackbone=ResNet-502026.04 | 72.94 | 43.18 | 67.32 | 39.47 | 64.44 | 422.1 | — | — | — | — | — | — | — | — | |
| FFBackbone=ViT-L/162026.04 | 70.19 | 34.27 | 71.23 | 44.73 | 67.11 | 420.6 | — | — | — | — | — | — | — | — | |
| FFBackbone=ResNet-502026.04 | 68.47 | 33.18 | 69.47 | 42.18 | 66.02 | 392.3 | — | — | — | — | — | — | — | — | |
| NGBackbone=ViT-L/162026.04 | 68.03 | 52.84 | 58.33 | 50.42 | 71.94 | 336.9 | — | — | — | — | — | — | — | — | |
| NGBackbone=ResNet-502026.04 | 66.44 | 49.91 | 57.12 | 48.57 | 72.31 | 308.2 | — | — | — | — | — | — | — | — | |
| CATABackbone=ViT-L/14, Step=Step 12026.05 | 65.39 | — | — | — | — | — | 0 | 77 | 61 | 81 | 23 | 64.39 | — | — | |
| GABackbone=ViT-L/162026.04 | 63.81 | 38.42 | 61.57 | 77.12 | 69.41 | 952.4 | — | — | — | — | — | — | — | — | |
| GABackbone=ResNet-502026.04 | 61.32 | 40.63 | 60.14 | 79.34 | 71.12 | 908.3 | — | — | — | — | — | — | — | — | |
| GABackbone=ViT-L/14, Step=Step 12026.05 | 61.21 | — | — | — | — | — | 26 | 64 | 32 | 78 | 40 | 60.55 | — | — | |
| OriginalBackbone=ViT-B/32, Step=Step 02026.05 | 61.2 | — | — | — | — | — | 66 | 61 | 72 | 61 | 80 | 61.54 | — | — | |
| GABackbone=ViT-B/32, Step=Step 12026.05 | 57.77 | — | — | — | — | — | 11 | 38 | 66 | 56 | 65 | 57.24 | — | — | |
| CATABackbone=ViT-B/32, Step=Step 12026.05 | 55.69 | — | — | — | — | — | 0 | 45 | 68 | 44 | 62 | 55.1 | — | — | |
| GABackbone=ViT-B/32, Step=Step 22026.05 | 53.15 | — | — | — | — | — | 14 | 22 | 59 | 48 | 79 | 52.71 | — | — | |
| GABackbone=ViT-B/32, Step=Step 32026.05 | 52.13 | — | — | — | — | — | 15 | 21 | 40 | 44 | 78 | 51.5 | — | — | |
| CATABackbone=ViT-L/14, Step=Step 32026.05 | 50.74 | — | — | — | — | — | 24 | 2 | 4 | 43 | 28 | 49.21 | — | — | |
| CATABackbone=ViT-L/14, Step=Step 52026.05 | 50.55 | — | — | — | — | — | 4 | 4 | 5 | 3 | 1 | 50.41 | 2 | 91.21 | |
| CATABackbone=ViT-B/32, Step=Step 52026.05 | 50.39 | — | — | — | — | — | 1 | 5 | 8 | 7 | 5 | 48.13 | 2.2 | 91.72 | |
| CATABackbone=ViT-L/14, Step=Step 22026.05 | 49.46 | — | — | — | — | — | 26 | 0 | 44 | 36 | 40 | 48.45 | — | — | |
| CATABackbone=ViT-B/32, Step=Step 32026.05 | 47.43 | — | — | — | — | — | 1 | 2 | 7 | 38 | 53 | 46.07 | — | — | |
| CATABackbone=ViT-B/32, Step=Step 42026.05 | 46.61 | — | — | — | — | — | 1 | 2 | 9 | 3 | 44 | 44.87 | — | — | |
| CATABackbone=ViT-L/14, Step=Step 42026.05 | 46.12 | — | — | — | — | — | 25 | 2 | 6 | 2 | 28 | 44.44 | — | — | |
| CATABackbone=ViT-B/32, Step=Step 22026.05 | 45.38 | — | — | — | — | — | 2 | 0 | 64 | 38 | 76 | 44.91 | — | — | |
| GABackbone=ViT-B/32, Step=Step 52026.05 | 43.58 | — | — | — | — | — | 15 | 17 | 38 | 23 | 52 | 42.85 | 3 | 74.23 | |
| GABackbone=ViT-B/32, Step=Step 42026.05 | 39.12 | — | — | — | — | — | 8 | 11 | 23 | 19 | 63 | 38.4 | — | — | |
| GABackbone=ViT-L/14, Step=Step 32026.05 | 24.77 | — | — | — | — | — | 15 | 20 | 8 | 16 | 14 | 24.26 | — | — | |
| GABackbone=ViT-L/14, Step=Step 22026.05 | 19.29 | — | — | — | — | — | 10 | 9 | 7 | 10 | 15 | 18.84 | — | — | |
| GABackbone=ViT-L/14, Step=Step 42026.05 | 10.69 | — | — | — | — | — | 14 | 16 | 4 | 11 | 3 | 10.64 | — | — | |
| LIPBackbone=ViT-L/14, Step=Step 12026.05 | 8.89 | — | — | — | — | — | 0 | 37 | 0 | 0 | 0 | 8.8 | — | — | |
| GABackbone=ViT-L/14, Step=Step 52026.05 | 6.01 | — | — | — | — | — | 13 | 7 | 0 | 5 | 2 | 5.98 | 5.8 | 74.14 | |
| LIPBackbone=ViT-B/32, Step=Step 12026.05 | 2.46 | — | — | — | — | — | 0 | 0 | 0 | 0 | 0 | 2.34 | — | — | |
| LIPBackbone=ViT-B/32, Step=Step 32026.05 | 0.63 | — | — | — | — | — | 25 | 23 | 13 | 0 | 0 | 1.19 | — | — | |
| LIPBackbone=ViT-B/32, Step=Step 52026.05 | 0.61 | — | — | — | — | — | 42 | 1 | 3 | 0 | 9 | 1.1 | 21 | 40.42 | |
| LIPBackbone=ViT-B/32, Step=Step 42026.05 | 0.51 | — | — | — | — | — | 52 | 10 | 10 | 0 | 0 | 1.21 | — | — | |
| LIPBackbone=ViT-B/32, Step=Step 22026.05 | 0.22 | — | — | — | — | — | 69 | 54 | 0 | 0 | 0 | 1.42 | — | — | |
| LIPBackbone=ViT-L/14, Step=Step 22026.05 | 0.03 | — | — | — | — | — | 24 | 94 | 0 | 0 | 1 | 1.22 | — | — | |
| LIPBackbone=ViT-L/14, Step=Step 32026.05 | 0.02 | — | — | — | — | — | 13 | 93 | 2 | 0 | 1 | 1.11 | — | — | |
| LIPBackbone=ViT-L/14, Step=Step 42026.05 | 0.02 | — | — | — | — | — | 11 | 93 | 2 | 0 | 0 | 1.08 | — | — | |
| LIPBackbone=ViT-L/14, Step=Step 52026.05 | 0.01 | — | — | — | — | — | 10 | 84 | 2 | 0 | 8 | 1.03 | 4 | 36.85 |