Continual Learning on ImageNet 100 (test)
91.4Task 10 AccuracyUpper-bound
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Upper-bound2023.05 | 91.4 | — | — | — | — | — | — | — | — | — | — | |
| MaPLeBackbone=ViT-L/14, Batch size=322024.03 | 84.81 | — | — | — | — | — | — | — | — | — | — | |
| AttriCLIP + CLAP (Ours)Backbone=ViT-L/14, Batch size=322024.03 | 84.14 | — | — | — | — | — | — | — | — | — | — | |
| CLAP (Ours)Backbone=ViT-L/14, Batch size=322024.03 | 83.51 | — | — | — | — | — | — | — | — | — | — | |
| AttriCLIPBackbone=ViT-L/14, Batch size=322024.03 | 83.3 | — | — | — | — | — | — | — | — | — | — | |
| MaPLe + CLAP (Ours)Backbone=ViT-L/14, Batch size=322024.03 | 82.97 | — | — | — | — | — | — | — | — | — | — | |
| CoOp + CLAP (Ours)Backbone=ViT-L/14, Batch size=322024.03 | 82 | — | — | — | — | — | — | — | — | — | — | |
| DualPromptBackbone=ViT-L/14, Batch size=322024.03 | 81.9 | — | — | — | — | — | — | — | — | — | — | |
| AttriCLIPMemory=02023.05 | 81.4 | 95.4 | 89.4 | 88.9 | 88.5 | 85.6 | 87.5 | 86.9 | 86.6 | 87.3 | — | |
| PROOFBackbone=ViT-L/14, Batch size=322024.03 | 81.26 | — | — | — | — | — | — | — | — | — | — | |
| ARIMemory=20002023.05 | 79.3 | 87.6 | 85.4 | 83.1 | 82.6 | 80.4 | 80.8 | 80.5 | 80.1 | 79.6 | — | |
| CoOpMemory=10002023.05 | 79.3 | 89.2 | 83.2 | 76.7 | 79.8 | 79.9 | 82.3 | 79.7 | 80.1 | 80.3 | — | |
| CoOpBackbone=ViT-L/14, Batch size=322024.03 | 79.3 | — | — | — | — | — | — | — | — | — | — | |
| Continual-CLIPMemory=02023.05 | 75.4 | 93.3 | 87.6 | 83.1 | 81.7 | 80.5 | 80.2 | 79.3 | 78.5 | 76.9 | — | |
| Continual-CLIPBackbone=ViT-L/14, Batch size=322024.03 | 75.4 | — | — | — | — | — | — | — | — | — | — | |
| DERMemory=20002023.05 | 66.7 | 81.7 | 80.6 | 76 | 72.1 | 74.4 | 71.8 | 70.5 | 68.3 | 67.3 | — | |
| iCaRLMemory=20002023.05 | 59.5 | 82.1 | 80.6 | 75.5 | 70.1 | 68.1 | 65.8 | 62.5 | 61.3 | 60.7 | — | |
| DER++Memory Size M=50002023.12 | — | — | — | — | — | — | — | — | — | — | 42.97 | |
| DER++ + CCL-DCMemory Size M=50002023.12 | — | — | — | — | — | — | — | — | — | — | 35.32 | |
| ERMemory Size M=50002023.12 | — | — | — | — | — | — | — | — | — | — | 39.26 | |
| ER + CCL-DCMemory Size M=50002023.12 | — | — | — | — | — | — | — | — | — | — | 37.78 | |
| ER-ACEMemory Size M=50002023.12 | — | — | — | — | — | — | — | — | — | — | 23.92 | |
| ER-ACE + CCL-DCMemory Size M=50002023.12 | — | — | — | — | — | — | — | — | — | — | 34.43 | |
| GSAMemory Size M=50002023.12 | — | — | — | — | — | — | — | — | — | — | 35.44 | |
| GSA + CCL-DCMemory Size M=50002023.12 | — | — | — | — | — | — | — | — | — | — | 40.46 | |
| OCMMemory Size M=50002023.12 | — | — | — | — | — | — | — | — | — | — | 4.55 | |
| OCM + CCL-DCMemory Size M=50002023.12 | — | — | — | — | — | — | — | — | — | — | 15.33 | |
| OnProMemory Size M=50002023.12 | — | — | — | — | — | — | — | — | — | — | 14.44 | |
| OnPro + CCL-DCMemory Size M=50002023.12 | — | — | — | — | — | — | — | — | — | — | 15.72 |