Continual Learning on CIFAR100 (test)
95.41Mean AccuracyJoint Train
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Joint TrainBackbone=ViT-B/16, Pre-trained=ImageNet-21K, Training Strategy=Joint2026.02 | 95.41 | — | — | — | — | — | — | — | — | — | 92.82 | — | — | |
| EWC-LoRABackbone=ViT-B/16, Pre-trained=ImageNet-21K, Training Strategy=Sequential2026.02 | 92.27 | — | — | — | — | — | — | — | — | — | 87.91 | — | — | |
| CL-LoRABackbone=ViT-B/16, Pre-trained=ImageNet-21K, Training Strategy=Sequential2026.02 | 92.25 | — | — | — | — | — | — | — | — | — | 87.65 | — | — | |
| InfLoRABackbone=ViT-B/16, Pre-trained=ImageNet-21K, Training Strategy=Sequential2026.02 | 91.33 | — | — | — | — | — | — | — | — | — | 86.34 | — | — | |
| SD-LoRABackbone=ViT-B/16, Pre-trained=ImageNet-21K, Training Strategy=Sequential2026.02 | 90.96 | — | — | — | — | — | — | — | — | — | 86.77 | — | — | |
| CODA-PromptBackbone=ViT-B/16, Pre-trained=ImageNet-21K, Training Strategy=Sequential2026.02 | 90.67 | — | — | — | — | — | — | — | — | — | 86.31 | — | — | |
| BiLoRABackbone=ViT-B/16, Pre-trained=ImageNet-21K, Training Strategy=Sequential2026.02 | 90.62 | — | — | — | — | — | — | — | — | — | 85.99 | — | — | |
| Vanilla LoRABackbone=ViT-B/16, Pre-trained=ImageNet-21K, Training Strategy=Sequential2026.02 | 89.74 | — | — | — | — | — | — | — | — | — | 82.99 | — | — | |
| JointMemory=N/A2025.09 | 89.24 | — | — | — | — | — | — | — | — | — | — | 90.94 | — | |
| FinetuneBackbone=ViT-B/16, Pre-trained=ImageNet-21K, Training Strategy=Sequential2026.02 | 88.17 | — | — | — | — | — | — | — | — | — | 79.09 | — | — | |
| L2PBackbone=ViT-B/16, Pre-trained=ImageNet-21K, Training Strategy=Sequential2026.02 | 87.69 | — | — | — | — | — | — | — | — | — | 83.18 | — | — | |
| DualPromptBackbone=ViT-B/16, Pre-trained=ImageNet-21K, Training Strategy=Sequential2026.02 | 86.41 | — | — | — | — | — | — | — | — | — | 81.48 | — | — | |
| CMMMemory=Θ(1)2025.09 | 80.21 | — | — | — | — | — | — | — | — | — | — | 77.72 | — | |
| ADR-SNNsteps=102023.09 | 80.12 | — | — | — | — | — | — | — | — | — | — | — | 0.25 | |
| TIESMemory=Θ(N)2025.09 | 79.75 | — | — | — | — | — | — | — | — | — | — | 77.23 | — | |
| MaxAbsMemory=Θ(N)2025.09 | 79.54 | — | — | — | — | — | — | — | — | — | — | 76.75 | — | |
| RandMixMemory=Θ(N)2025.09 | 79.46 | — | — | — | — | — | — | — | — | — | — | 77.04 | — | |
| AvgMemory=Θ(N)2025.09 | 79.46 | — | — | — | — | — | — | — | — | — | — | 77.04 | — | |
| EWCMemory=Θ(1)2025.09 | 79.33 | — | — | — | — | — | — | — | — | — | — | 76.24 | — | |
| LwFMemory=Θ(1)2025.09 | 78.21 | — | — | — | — | — | — | — | — | — | — | 73.45 | — | |
| PROOFMemory=Θ(N)2025.09 | 78.13 | — | — | — | — | — | — | — | — | — | — | 76.55 | — | |
| CODA-PMemory=Θ(N)2025.09 | 77.95 | — | — | — | — | — | — | — | — | — | — | 76.4 | — | |
| DSD-SNNsteps=102023.09 | 77.92 | — | — | — | — | — | — | — | — | — | — | — | 0.29 | |
| MaPLeMemory=Θ(1)2025.09 | 77.12 | — | — | — | — | — | — | — | — | — | — | 74.52 | — | |
| DualPromptMemory=Θ(N)2025.09 | 75.36 | — | — | — | — | — | — | — | — | — | — | 74.31 | — | |
| CoOpMemory=Θ(1)2025.09 | 74.62 | — | — | — | — | — | — | — | — | — | — | 70.58 | — | |
| CLIP-AdapterMemory=Θ(1)2025.09 | 73.21 | — | — | — | — | — | — | — | — | — | — | 68.32 | — | |
| Continual-CLIPMemory=Θ(1)2025.09 | 72.6 | — | — | — | — | — | — | — | — | — | — | 68.26 | — | |
| AttriCLIPMemory=Θ(1)2025.09 | 72.49 | — | — | — | — | — | — | — | — | — | — | 68.45 | — | |
| Zero-shotMemory=Θ(1)2025.09 | 72.32 | — | — | — | — | — | — | — | — | — | — | 66.91 | — | |
| Joint (upper bound)Backbone=ResNet-182026.02 | 71.15 | — | — | — | — | — | — | — | — | — | — | — | — | |
| L2PMemory=Θ(N)2025.09 | 69.69 | — | — | — | — | — | — | — | — | — | — | 70.04 | — | |
| VPTMemory=Θ(1)2025.09 | 66.66 | — | — | — | — | — | — | — | — | — | — | 59.33 | — | |
| LSTM_NETsteps=102023.09 | 66.61 | — | — | — | — | — | — | — | — | — | — | — | 3.77 | |
| SIsteps=102023.09 | 64.81 | — | — | — | — | — | — | — | — | — | — | — | 1 | |
| MASsteps=102023.09 | 64.77 | — | — | — | — | — | — | — | — | — | — | — | 0.78 | |
| HNETsteps=102023.09 | 63.57 | — | — | — | — | — | — | — | — | — | — | — | 1.03 | |
| EWCsteps=102023.09 | 61.11 | — | — | — | — | — | — | — | — | — | — | — | 1.43 | |
| BFP+IDBuffer Size=2000, Backbone=ResNet-182026.02 | 57.74 | — | — | — | — | — | — | — | — | — | — | — | — | |
| XDERBuffer Size=2000, Backbone=ResNet-182026.02 | 57.57 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BFPBuffer Size=2000, Backbone=ResNet-182026.02 | 57.39 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SARLBuffer Size=2000, Backbone=ResNet-182026.02 | 57.06 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ER+IDBuffer Size=2000, Backbone=ResNet-182026.02 | 56.59 | — | — | — | — | — | — | — | — | — | — | — | — | |
| CLS-ER+IDBuffer Size=2000, Backbone=ResNet-182026.02 | 56.36 | — | — | — | — | — | — | — | — | — | — | — | — | |
| CLS-ERBuffer Size=2000, Backbone=ResNet-182026.02 | 54.84 | — | — | — | — | — | — | — | — | — | — | — | — | |
| iCaRLBuffer Size=2000, Backbone=ResNet-182026.02 | 52.51 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DER++Buffer Size=2000, Backbone=ResNet-182026.02 | 51.82 | — | — | — | — | — | — | — | — | — | — | — | — | |
| iCaRLMemory=Θ(N)2025.09 | 50.66 | — | — | — | — | — | — | — | — | — | — | 57.6 | — | |
| LUCIRBuffer Size=2000, Backbone=ResNet-182026.02 | 50.42 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DERBuffer Size=2000, Backbone=ResNet-182026.02 | 50.12 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ER-ACEBuffer Size=2000, Backbone=ResNet-182026.02 | 49.77 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCoMMERBuffer Size=2000, Backbone=ResNet-182026.02 | 49.42 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BFP+IDBuffer Size=500, Backbone=ResNet-182026.02 | 48.53 | — | — | — | — | — | — | — | — | — | — | — | — | |
| XDERBuffer Size=500, Backbone=ResNet-182026.02 | 48.14 | — | — | — | — | — | — | — | — | — | — | — | — | |
| CLS-ER+IDBuffer Size=500, Backbone=ResNet-182026.02 | 47.44 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BiCBuffer Size=2000, Backbone=ResNet-182026.02 | 47.17 | — | — | — | — | — | — | — | — | — | — | — | — | |
| iCaRLBuffer Size=500, Backbone=ResNet-182026.02 | 46.81 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BFPBuffer Size=500, Backbone=ResNet-182026.02 | 46.7 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SARLBuffer Size=500, Backbone=ResNet-182026.02 | 46.69 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ER+IDBuffer Size=500, Backbone=ResNet-182026.02 | 44.82 | — | — | — | — | — | — | — | — | — | — | — | — | |
| CLS-ERBuffer Size=500, Backbone=ResNet-182026.02 | 43.92 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ERBuffer Size=2000, Backbone=ResNet-182026.02 | 40.47 | — | — | — | — | — | — | — | — | — | — | — | — | |
| SCoMMERBuffer Size=500, Backbone=ResNet-182026.02 | 39.05 | — | — | — | — | — | — | — | — | — | — | — | — | |
| LUCIRBuffer Size=500, Backbone=ResNet-182026.02 | 37.91 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BiCBuffer Size=500, Backbone=ResNet-182026.02 | 37.82 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ER-ACEBuffer Size=500, Backbone=ResNet-182026.02 | 37.81 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DER++Buffer Size=500, Backbone=ResNet-182026.02 | 37.69 | — | — | — | — | — | — | — | — | — | — | — | — | |
| DERBuffer Size=500, Backbone=ResNet-182026.02 | 34.83 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ERBuffer Size=500, Backbone=ResNet-182026.02 | 23.41 | — | — | — | — | — | — | — | — | — | — | — | — | |
| ARIMemory=20002023.05 | — | 88.6 | 86.9 | 85.8 | 84.6 | 83.1 | 81.8 | 81.6 | 81 | 80.2 | 80.9 | — | — | |
| AttriCLIPMemory=02023.05 | — | 97.8 | 93.7 | 91 | 87.5 | 84.7 | 82.5 | 81.3 | 80.5 | 80 | 79.7 | — | — | |
| Continual-CLIPMemory=02023.05 | — | 96.7 | 92.2 | 86 | 80.4 | 77.5 | 75.8 | 73 | 71.4 | 69.8 | 66.7 | — | — | |
| CoOpMemory=10002023.05 | — | 95.8 | 90.7 | 85.2 | 83.4 | 80.8 | 75.8 | 74.7 | 71.7 | 71.3 | 67.6 | — | — | |
| iCaRLMemory=20002023.05 | — | 88.7 | 78.1 | 72.4 | 67.2 | 63.7 | 60.2 | 56.4 | 54.4 | 51.9 | 49.5 | — | — | |
| iTAMLMemory=20002023.05 | — | 89.2 | 89 | 87.3 | 86.2 | 84.3 | 82.1 | 80.7 | 79.1 | 78.4 | 77.8 | — | — | |
| LwFMemory=02023.05 | — | 89.3 | 70.1 | 54.3 | 45.8 | 39.8 | 36.1 | 31.7 | 28.9 | 24.4 | 23.9 | — | — | |
| Upper-boundMemory=N/A2023.05 | — | — | — | — | — | — | — | — | — | — | 86.3 | — | — |