Class-incremental learning on CIFAR-100 (10 tasks, test)
92.22Average Top-1 AccuracyOne-A
Evaluation results
| Method | Links | |||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| One-ATask numbers (T)=10, Step imbalance factor (gamma)=0.012026.03 | 92.22 | — | — | — | — | — | — | — | — | — | — | 88.23 | — | — | — | — | — | |
| RanPACAlgorithm=12023.07 | 92.2 | — | — | — | — | — | — | — | — | — | — | — | — | 36 | — | — | — | |
| APER AdapterOptimization Strategy=FO Optimization2025.10 | 92.15 | — | — | — | — | — | — | — | — | — | — | 87.41 | — | — | 4.42 | — | — | |
| EASEOptimization Strategy=FO Optimization2025.10 | 92.1 | — | — | — | — | — | — | — | — | — | — | 87.67 | — | — | 5.94 | — | — | |
| Adapter + Cls.Optimization Strategy=FO Optimization2025.10 | 92.04 | — | — | — | — | — | — | — | — | — | — | 88.54 | — | — | 5.48 | — | — | |
| EASETask numbers (T)=10, Step imbalance factor (gamma)=0.012026.03 | 91.71 | — | — | — | — | — | — | — | — | — | — | 86.9 | — | — | — | — | — | |
| InfLoRA2024.03 | 91.7 | — | — | — | — | — | — | — | — | — | 86.51 | — | — | — | — | — | — | |
| InfLoRAOptimization Strategy=FO Optimization2025.10 | 91.6 | — | — | — | — | — | — | — | — | — | — | 86.44 | — | — | 4.6 | — | — | |
| InfLoRA-b5budget=52024.03 | 91.59 | — | — | — | — | — | — | — | — | — | 87.06 | — | — | — | — | — | — | |
| LAE AdapterOptimization Strategy=FO Optimization2025.10 | 91.31 | — | — | — | — | — | — | — | — | — | — | 86.54 | — | — | 5.58 | — | — | |
| ZO-FCOptimization Strategy=ZO Optimization2025.10 | 91.13 | — | — | — | — | — | — | — | — | — | — | 86.93 | — | — | 3.42 | — | — | |
| CODA-P2024.03 | 91.08 | — | — | — | — | — | — | — | — | — | 86.62 | — | — | — | — | — | — | |
| Aper-adapterTask numbers (T)=10, Step imbalance factor (gamma)=0.012026.03 | 91.04 | — | — | — | — | — | — | — | — | — | — | 86.47 | — | — | — | — | — | |
| SEMATask numbers (T)=10, Step imbalance factor (gamma)=0.012026.03 | 90.96 | — | — | — | — | — | — | — | — | — | — | 86.53 | — | — | — | — | — | |
| CODA-PromptOptimization Strategy=FO Optimization2025.10 | 90.76 | — | — | — | — | — | — | — | — | — | — | 85.7 | — | — | 4.23 | — | — | |
| RanPAC (No RPs)RP layer=false2023.07 | 90.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| ACMapTask numbers (T)=10, Step imbalance factor (gamma)=0.012026.03 | 90.27 | — | — | — | — | — | — | — | — | — | — | 84.61 | — | — | — | — | — | |
| DualPrompt2024.03 | 90.06 | — | — | — | — | — | — | — | — | — | 84.42 | — | — | — | — | — | — | |
| LAE2024.03 | 89.84 | — | — | — | — | — | — | — | — | — | 84.15 | — | — | — | — | — | — | |
| InfLoRATask numbers (T)=10, Step imbalance factor (gamma)=0.012026.03 | 89.24 | — | — | — | — | — | — | — | — | — | — | 83.78 | — | — | — | — | — | |
| RanPAC (No Phase 1)Phase 1=false2023.07 | 89 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CL-LoRATask numbers (T)=10, Step imbalance factor (gamma)=0.012026.03 | 88.83 | — | — | — | — | — | — | — | — | — | — | 80.06 | — | — | — | — | — | |
| C-LORA2024.03 | 88.81 | — | — | — | — | — | — | — | — | — | 82.97 | — | — | — | — | — | — | |
| Joint linear probeJoint training=true2023.07 | 87.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RanPAC (NCM with Phase 1)Evaluation=NCM, Phase 1=true2023.07 | 87.8 | — | — | — | — | — | — | — | — | — | — | — | — | 17 | — | — | — | |
| L2P2024.03 | 87.64 | — | — | — | — | — | — | — | — | — | 82.48 | — | — | — | — | — | — | |
| ADaM2023.07 | 87.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| L2POptimization Strategy=FO Optimization2025.10 | 87.59 | — | — | — | — | — | — | — | — | — | — | 82.43 | — | — | 11.56 | — | — | |
| CODA-PromptTask numbers (T)=10, Step imbalance factor (gamma)=0.012026.03 | 87.55 | — | — | — | — | — | — | — | — | — | — | 81.4 | — | — | — | — | — | |
| SimpleCILOptimization Strategy=Classifier Only2025.10 | 87.13 | — | — | — | — | — | — | — | — | — | — | 81.26 | — | — | 6.08 | — | — | |
| Learnable Cls.Optimization Strategy=FO Optimization2025.10 | 87.03 | — | — | — | — | — | — | — | — | — | — | 80.92 | — | — | 4.31 | — | — | |
| RanPAC (No RPs or Phase 1)RP layer=false, Phase 1=false2023.07 | 87 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| CODA-Prompt2023.07 | 86.3 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| L2P2023.07 | 84.6 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| DualPrompt2023.07 | 84.1 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | — | |
| RanPAC (NCM only)Evaluation=NCM, Phase 1=false2023.07 | 83.4 | — | — | — | — | — | — | — | — | — | — | — | — | 15 | — | — | — | |
| DualPromptTask numbers (T)=10, Step imbalance factor (gamma)=0.012026.03 | 81.12 | — | — | — | — | — | — | — | — | — | — | 71.43 | — | — | — | — | — | |
| sequentialtraining_mode=sequential training2024.03 | 80.42 | — | — | — | — | — | — | — | — | — | 62.18 | — | — | — | — | — | — | |
| Oracle w/ LingoCLBackbone=ResNet-182024.03 | 78 | — | — | — | — | — | — | — | — | — | — | 78 | — | — | — | — | — | |
| OracleBackbone=ResNet-182024.03 | 77.6 | — | — | — | — | — | — | — | — | — | — | 77.6 | — | — | — | — | — | |
| DyTox++#P=10.73M, variant=row 72021.11 | 77.1 | — | — | — | — | — | — | — | — | — | 64.53 | — | — | — | — | — | — | |
| DyTox++#P=10.73M, variant=row 92021.11 | 77.01 | — | — | — | — | — | — | — | — | — | 67.53 | — | — | — | — | — | — | |
| DyTox+#P=10.73M, variant=row 82021.11 | 76.74 | — | — | — | — | — | — | — | — | — | 67.04 | — | — | — | — | — | — | |
| L2PTask numbers (T)=10, Step imbalance factor (gamma)=0.012026.03 | 76.69 | — | — | — | — | — | — | — | — | — | — | 64.63 | — | — | — | — | — | |
| DyTox+#P=10.73M, variant=row 62021.11 | 75.54 | — | — | — | — | — | — | — | — | — | 62.06 | — | — | — | — | — | — | |
| DER w/o P#P=112.27M2021.11 | 75.36 | — | — | — | — | — | — | — | — | — | 65.22 | — | — | — | — | — | — | |
| DNE-4headsBackbone=Transformer, Number of heads=4, FLOPs (F)=4.02G2023.03 | 74.86 | — | — | — | — | — | — | — | — | — | — | 70.04 | 6.08 | — | — | — | — | |
| DNE-2headsBackbone=Transformer, Number of heads=2, FLOPs (F)=3.10G2023.03 | 74.61 | — | — | — | — | — | — | — | — | — | — | 69.73 | 6.39 | — | — | — | — | |
| DNE-1headBackbone=Transformer, Number of heads=1, FLOPs (F)=2.68G2023.03 | 73.68 | — | — | — | — | — | — | — | — | — | — | 68.04 | 8.08 | — | — | — | — | |
| DyTox#P=10.73M2021.11 | 73.66 | — | — | — | — | — | — | — | — | — | 60.67 | — | — | — | — | — | — | |
| FOSTERBackbone=ResNet18, FLOPs (F)=1.12G2023.03 | 72.2 | — | — | — | — | — | — | — | — | — | — | 63.31 | 17.1 | — | — | — | — | |
| DyTox w/ LingoCLBackbone=ConViT2024.03 | 71.9 | — | — | — | — | — | — | — | — | — | — | 58.9 | — | — | 24.9 | — | — | |
| DERBackbone=ResNet18, FLOPs (F)=6.68G2023.03 | 71.69 | — | — | — | — | — | — | — | — | — | — | 63.78 | 16.63 | — | — | — | — | |
| DytoxBackbone=Transformer, FLOPs (F)=1.38G2023.03 | 71.55 | — | — | — | — | — | — | — | — | — | — | 64.06 | 12.06 | — | — | — | — | |
| Upper BoundReplay Data=None2021.06 | 69.9 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 100 | — | |
| DyToxBackbone=ConViT2024.03 | 69.5 | — | — | — | — | — | — | — | — | — | — | 52.8 | — | — | 33 | — | — | |
| WA#P=11.22M2021.11 | 69.46 | — | — | — | — | — | — | — | — | — | 53.78 | — | — | — | — | — | — | |
| TagFex + OursNumber of tasks=10, Replay buffer size=20 exemplars per class2026.03 | 68.68 | — | — | — | — | — | — | — | — | — | — | 57.91 | — | — | — | — | — | |
| PODNetBackbone=ResNet18, FLOPs (F)=1.12G2023.03 | 66.41 | — | — | — | — | — | — | — | — | — | — | 52.46 | 27.95 | — | — | — | — | |
| DER + OursNumber of tasks=10, Replay buffer size=20 exemplars per class2026.03 | 66.33 | — | — | — | — | — | — | — | — | — | — | 53.82 | — | — | — | — | — | |
| TagFexNumber of tasks=10, Replay buffer size=20 exemplars per class2026.03 | 65.97 | — | — | — | — | — | — | — | — | — | — | 55.99 | — | — | — | — | — | |
| AANet w/ LingoCLBackbone=ResNet-182024.03 | 65.4 | — | — | — | — | — | — | — | — | — | — | 50.4 | — | — | — | — | — | |
| FOSTER + OursNumber of tasks=10, Replay buffer size=20 exemplars per class2026.03 | 64.8 | — | — | — | — | — | — | — | — | — | — | 52.76 | — | — | — | — | — | |
| AANetBackbone=ResNet-182024.03 | 64.6 | — | — | — | — | — | — | — | — | — | — | 49.1 | — | — | — | — | — | |
| MEMO + OursNumber of tasks=10, Replay buffer size=20 exemplars per class2026.03 | 63.81 | — | — | — | — | — | — | — | — | — | — | 52.85 | — | — | — | — | — | |
| DERNumber of tasks=10, Replay buffer size=20 exemplars per class2026.03 | 63.53 | — | — | — | — | — | — | — | — | — | — | 50.75 | — | — | — | — | — | |
| IL2M w/ LingoCLBackbone=ResNet-182024.03 | 62.1 | — | — | — | — | — | — | — | — | — | — | 48.1 | — | — | 37.8 | — | — | |
| FOSTERNumber of tasks=10, Replay buffer size=20 exemplars per class2026.03 | 62.04 | — | — | — | — | — | — | — | — | — | — | 49.3 | — | — | — | — | — | |
| LUCIR w/ LingoCLBackbone=ResNet-182024.03 | 61.9 | — | — | — | — | — | — | — | — | — | — | 47.5 | — | — | 36.5 | — | — | |
| MEMONumber of tasks=10, Replay buffer size=20 exemplars per class2026.03 | 61.68 | — | — | — | — | — | — | — | — | — | — | 51.7 | — | — | — | — | — | |
| iCaRL + OursNumber of tasks=10, Replay buffer size=20 exemplars per class2026.03 | 60.82 | — | — | — | — | — | — | — | — | — | — | 47.36 | — | — | — | — | — | |
| CwD w/ LingoCLBackbone=ResNet-182024.03 | 60.6 | — | — | — | — | — | — | — | — | — | — | 47.6 | — | — | 35.3 | — | — | |
| BiMeCo w/ LingoCLBackbone=MobileNet-V2†2024.03 | 60.2 | — | — | — | — | — | — | — | — | — | — | 46.4 | — | — | 32.3 | — | — | |
| LUCIRBackbone=ResNet-182024.03 | 60.2 | — | — | — | — | — | — | — | — | — | — | 46.5 | — | — | 37.3 | — | — | |
| BiC w/ LingoCLBackbone=ResNet-182024.03 | 60.1 | — | — | — | — | — | — | — | — | — | — | 43.4 | — | — | 20.5 | — | — | |
| CwDBackbone=ResNet-182024.03 | 60 | — | — | — | — | — | — | — | — | — | — | 46.7 | — | — | 36.9 | — | — | |
| BiMeCoBackbone=MobileNet-V2†2024.03 | 59.7 | — | — | — | — | — | — | — | — | — | — | 45.9 | — | — | 35.4 | — | — | |
| iCaRLBackbone=ResNet18, FLOPs (F)=1.12G2023.03 | 59.32 | — | — | — | — | — | — | — | — | — | — | 44.72 | 31.4 | — | — | — | — | |
| iCaRLNumber of tasks=10, Replay buffer size=20 exemplars per class2026.03 | 58.76 | — | — | — | — | — | — | — | — | — | — | 45.39 | — | — | — | — | — | |
| BiCBackbone=ResNet-182024.03 | 57.8 | — | — | — | — | — | — | — | — | — | — | 41.2 | — | — | 26.7 | — | — | |
| IL2MBackbone=ResNet-182024.03 | 57.8 | — | — | — | — | — | — | — | — | — | — | 44.3 | — | — | 41 | — | — | |
| EEILNormalization=TBBN, Backbone=ResNet-322022.01 | 57.53 | 79.93 | — | — | — | — | — | — | — | — | 41.93 | — | 0.378 | — | — | — | — | |
| AFCNormalization=TBBN, Backbone=ResNet-322022.01 | 57.31 | 73.57 | — | — | — | — | — | — | — | — | 41.3 | — | 0.3289 | — | — | — | — | |
| FTNormalization=TBBN, Backbone=ResNet-322022.01 | 56.17 | 80.36 | — | — | — | — | — | — | — | — | 38.46 | — | 0.419 | — | — | — | — | |
| LUCIRNormalization=TBBN, Backbone=ResNet-322022.01 | 56.13 | 70.68 | — | — | — | — | — | — | — | — | 41.45 | — | 0.2923 | — | — | — | — | |
| LUCIRNormalization=CN, Backbone=ResNet-322022.01 | 55.6 | 71.85 | — | — | — | — | — | — | — | — | 38.07 | — | 0.3378 | — | — | — | — | |
| EEILNormalization=BN, Backbone=ResNet-322022.01 | 55.25 | 79.22 | — | — | — | — | — | — | — | — | 39.82 | — | 0.394 | — | — | — | — | |
| EEILNormalization=CN, Backbone=ResNet-322022.01 | 55.09 | 79.29 | — | — | — | — | — | — | — | — | 39.98 | — | 0.3931 | — | — | — | — | |
| FTNormalization=CN, Backbone=ResNet-322022.01 | 54.43 | 80.64 | — | — | — | — | — | — | — | — | 35.06 | — | 0.4382 | — | — | — | — | |
| SSILNormalization=TBBN, Backbone=ResNet-322022.01 | 54.28 | 59.37 | — | — | — | — | — | — | — | — | 43.8 | — | 0.1512 | — | — | — | — | |
| LUCIRNormalization=BN, Backbone=ResNet-322022.01 | 54.2 | 70.41 | — | — | — | — | — | — | — | — | 38.06 | — | 0.3235 | — | — | — | — | |
| AFCNormalization=BN, Backbone=ResNet-322022.01 | 53.93 | 73.1 | — | — | — | — | — | — | — | — | 39.9 | — | 0.3317 | — | — | — | — | |
| FTNormalization=BN, Backbone=ResNet-322022.01 | 53.88 | 78.79 | — | — | — | — | — | — | — | — | 35.41 | — | 0.4338 | — | — | — | — | |
| SSILNormalization=BN, Backbone=ResNet-322022.01 | 53 | 56.02 | — | — | — | — | — | — | — | — | 41.34 | — | 0.1564 | — | — | — | — | |
| PODNetNormalization=TBBN, Backbone=ResNet-322022.01 | 52.98 | 51.78 | — | — | — | — | — | — | — | — | 37.9 | — | 0.139 | — | — | — | — | |
| PODNetNormalization=BN, Backbone=ResNet-322022.01 | 52.95 | 52.58 | — | — | — | — | — | — | — | — | 38.1 | — | 0.147 | — | — | — | — | |
| SSILNormalization=CN, Backbone=ResNet-322022.01 | 52.38 | 54.44 | — | — | — | — | — | — | — | — | 40.74 | — | 0.146 | — | — | — | — | |
| AFCNormalization=CN, Backbone=ResNet-322022.01 | 51.16 | 70.94 | — | — | — | — | — | — | — | — | 37.5 | — | 0.334 | — | — | — | — | |
| PODNetNormalization=CN, Backbone=ResNet-322022.01 | 50.26 | 50.52 | — | — | — | — | — | — | — | — | 34.8 | — | 0.1569 | — | — | — | — | |
| Always Be DreamingReplay Data=Synthetic2021.06 | 33.7 | — | — | — | — | — | — | — | — | — | — | — | — | — | — | 69.6 | — |