Continual Unlearning on ImageNet-1K
76.69Retention ScoreFT
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| FTBackbone=ViT-L/14, Step=Step 52026.05 | 76.69 | 66 | 56 | 48 | 56 | 88 | 76.62 | 6.8 | 42.08 | — | |
| FTBackbone=ViT-L/14, Step=Step 32026.05 | 76.4 | 62 | 16 | 52 | 62 | 68 | 76.28 | — | — | — | |
| FTBackbone=ViT-L/14, Step=Step 42026.05 | 76.29 | 54 | 14 | 50 | 68 | 96 | 76.19 | — | — | — | |
| FTBackbone=ViT-L/14, Step=Step 22026.05 | 75.81 | 28 | 46 | 50 | 64 | 66 | 75.68 | — | — | — | |
| FTBackbone=ViT-L/14, Step=Step 12026.05 | 75.36 | 58 | 18 | 32 | 62 | 78 | 75.23 | — | — | — | |
| OriginalBackbone=ViT-L/14, Step=Step 02026.05 | 71.72 | 38 | 46 | 34 | 52 | 88 | 71.62 | — | — | — | |
| CATABackbone=ViT-L/14, Step=Step 32026.05 | 70.71 | 0 | 0 | 0 | 52 | 86 | 70.49 | — | — | — | |
| CATABackbone=ViT-L/14, Step=Step 22026.05 | 70.69 | 0 | 0 | 40 | 50 | 90 | 70.52 | — | — | — | |
| CATABackbone=ViT-L/14, Step=Step 12026.05 | 70.66 | 0 | 66 | 36 | 46 | 88 | 70.55 | — | — | — | |
| CATABackbone=ViT-L/14, Step=Step 52026.05 | 70.22 | 0 | 0 | 0 | 8 | 10 | 69.89 | 1.6 | 96.56 | — | |
| GABackbone=ViT-L/14, Step=Step 12026.05 | 69.95 | 6 | 82 | 32 | 56 | 76 | 69.85 | — | — | — | |
| CATABackbone=ViT-L/14, Step=Step 42026.05 | 69.92 | 0 | 0 | 0 | 0 | 90 | 69.66 | — | — | — | |
| OriginalBackbone=RN502026.05 | 66.61 | — | — | — | — | — | 65.37 | — | — | 54.1 | |
| GABackbone=ViT-L/14, Step=Step 22026.05 | 64.96 | 2 | 12 | 36 | 48 | 26 | 64.76 | — | — | — | |
| FTBackbone=ViT-B/32, Step=Step 52026.05 | 63.85 | 40 | 10 | 46 | 34 | 88 | 63.75 | 5.2 | 55.32 | — | |
| FTBackbone=ViT-B/32, Step=Step 42026.05 | 63.63 | 46 | 14 | 46 | 30 | 82 | 63.53 | — | — | — | |
| FTBackbone=ViT-B/32, Step=Step 32026.05 | 63.5 | 42 | 10 | 50 | 30 | 88 | 63.4 | — | — | — | |
| FTBackbone=ViT-B/32, Step=Step 22026.05 | 63.26 | 52 | 12 | 46 | 28 | 90 | 63.17 | — | — | — | |
| FTBackbone=ViT-B/32, Step=Step 12026.05 | 62.45 | 56 | 14 | 50 | 26 | 88 | 62.37 | — | — | — | |
| OriginalBackbone=ViT-B/32, Step=Step 02026.05 | 59.36 | 64 | 24 | 32 | 22 | 90 | 59.29 | — | — | — | |
| GABackbone=ViT-B/32, Step=Step 12026.05 | 57.69 | 2 | 16 | 30 | 24 | 86 | 57.56 | — | — | — | |
| CATABackbone=ViT-B/32, Step=Step 12026.05 | 56.22 | 0 | 20 | 26 | 28 | 78 | 56.09 | — | — | — | |
| GABackbone=ViT-B/32, Step=Step 22026.05 | 55.25 | 0 | 0 | 34 | 44 | 84 | 55.13 | — | — | — | |
| CATABackbone=ViT-B/32, Step=Step 22026.05 | 55.17 | 0 | 0 | 24 | 36 | 70 | 55.02 | — | — | — | |
| CATABackbone=ViT-B/32, Step=Step 32026.05 | 54.73 | 0 | 0 | 0 | 22 | 58 | 54.54 | — | — | — | |
| OriginalBackbone=RN1012026.05 | 54.67 | — | — | — | — | — | 54.33 | — | — | 80 | |
| CATABackbone=ViT-B/32, Step=Step 52026.05 | 54.33 | 0 | 0 | 0 | 0 | 2 | 54.06 | 0 | 95.98 | — | |
| CATABackbone=ViT-B/32, Step=Step 42026.05 | 54.07 | 0 | 0 | 0 | 0 | 66 | 53.86 | — | — | — | |
| CATABackbone=RN1012026.05 | 53.06 | — | — | — | — | — | 52.96 | — | 97.56 | 0 | |
| CLIP-LIPBackbone=RN502026.05 | 52.77 | — | — | — | — | — | 53.78 | — | 91.98 | 37 | |
| GABackbone=ViT-B/32, Step=Step 32026.05 | 52.04 | 2 | 0 | 2 | 36 | 74 | 51.89 | — | — | — | |
| CATABackbone=RN502026.05 | 51.73 | — | — | — | — | — | 51.68 | — | 98.53 | 2 | |
| CLIP-LIPBackbone=RN1012026.05 | 50.84 | — | — | — | — | — | 51.49 | — | 95.96 | 2 | |
| TIFSBackbone=RN1012026.05 | 50.17 | — | — | — | — | — | 49.51 | — | 89.14 | 0 | |
| GABackbone=ViT-B/32, Step=Step 42026.05 | 48.34 | 0 | 0 | 0 | 12 | 62 | 48.17 | — | — | — | |
| TIFSBackbone=RN502026.05 | 44.67 | — | — | — | — | — | 47.34 | — | 91.01 | 0 | |
| GABackbone=ViT-B/32, Step=Step 52026.05 | 44.01 | 0 | 0 | 0 | 14 | 10 | 43.81 | 1.2 | 84.54 | — | |
| GABackbone=ViT-L/14, Step=Step 32026.05 | 43.76 | 0 | 4 | 2 | 34 | 0 | 43.58 | — | — | — | |
| GABackbone=RN1012026.05 | 38.76 | — | — | — | — | — | 38.75 | — | 64.43 | 32 | |
| EMMNBackbone=RN502026.05 | 36.67 | — | — | — | — | — | 32.25 | — | 58.4 | 10 | |
| GABackbone=RN502026.05 | 35.4 | — | — | — | — | — | 35.39 | — | 63.58 | 14.5 | |
| EMMNBackbone=RN1012026.05 | 29.33 | — | — | — | — | — | 26.43 | — | 44.17 | 68 | |
| GABackbone=ViT-L/14, Step=Step 42026.05 | 23.35 | 0 | 2 | 0 | 6 | 0 | 23.24 | — | — | — | |
| GABackbone=ViT-L/14, Step=Step 52026.05 | 6.04 | 0 | 2 | 0 | 10 | 2 | 6.02 | 4.4 | 57.81 | — | |
| LIPBackbone=ViT-L/14, Step=Step 12026.05 | 2.3 | 0 | 0 | 0 | 0 | 0 | 2.29 | — | — | — | |
| LIPBackbone=RN502026.05 | 1.75 | — | — | — | — | — | 1.14 | — | 19.06 | 0.95 | |
| LIPBackbone=ViT-B/32, Step=Step 12026.05 | 0.71 | 0 | 0 | 0 | 0 | 0 | 0.71 | — | — | — | |
| FTBackbone=RN1012026.05 | 0.51 | — | — | — | — | — | 27.62 | — | 49.09 | 0 | |
| FisherBackbone=RN1012026.05 | 0.38 | — | — | — | — | — | 0.27 | — | 18.57 | 1.12 | |
| FisherBackbone=RN502026.05 | 0.34 | — | — | — | — | — | 1.09 | — | 19.04 | 0.2 | |
| LIPBackbone=RN1012026.05 | 0.27 | — | — | — | — | — | 1.74 | — | 19.14 | 0.24 | |
| FTBackbone=RN502026.05 | 0.26 | — | — | — | — | — | 24.8 | — | 44.07 | 4 | |
| LIPBackbone=ViT-B/32, Step=Step 32026.05 | 0.17 | 0 | 0 | 0 | 0 | 0 | 0.17 | — | — | — | |
| LIPBackbone=ViT-L/14, Step=Step 22026.05 | 0.17 | 0 | 0 | 0 | 0 | 0 | 0.17 | — | — | — | |
| LIPBackbone=ViT-B/32, Step=Step 22026.05 | 0.15 | 0 | 0 | 0 | 0 | 0 | 0.15 | — | — | — | |
| LIPBackbone=ViT-B/32, Step=Step 42026.05 | 0.1 | 32 | 0 | 0 | 0 | 0 | 0.14 | — | — | — | |
| LIPBackbone=ViT-L/14, Step=Step 32026.05 | 0.07 | 18 | 0 | 0 | 0 | 0 | 0.08 | — | — | — | |
| LIPBackbone=ViT-L/14, Step=Step 42026.05 | 0.07 | 36 | 0 | 0 | 0 | 0 | 0.11 | — | — | — | |
| LIPBackbone=ViT-L/14, Step=Step 52026.05 | 0.04 | 48 | 0 | 0 | 0 | 0 | 0.09 | 9.6 | 36.27 | — | |
| LIPBackbone=ViT-B/32, Step=Step 52026.05 | 0.01 | 74 | 0 | 0 | 0 | 0 | 0.09 | 14.8 | 37.19 | — |