Continual Learning on Split CIFAR-100 (20 tasks)
94.08Mean Test AccuracySR2-LoRA
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SR2-LoRABackbone=ViT-B/16-IN21K2026.05 | 94.08 | — | — | — | 90.45 | — | — | — | — | — | — | |
| SSIATBackbone=ViT-B/16-IN21K2026.05 | 93.54 | — | — | — | 90.07 | — | — | — | — | — | — | |
| MACILBackbone=ViT-B/16-IN21K2026.05 | 93.47 | — | — | — | 90.31 | — | — | — | — | — | — | |
| SLCABackbone=ViT-B/16-IN21K2026.05 | 93.03 | — | — | — | 89.62 | — | — | — | — | — | — | |
| MOSBackbone=ViT-B/16-IN21K2026.05 | 92.97 | — | — | — | 89.48 | — | — | — | — | — | — | |
| LoRA-DRSBackbone=ViT-B/16-IN21K2026.05 | 92.35 | — | — | — | 88.76 | — | — | — | — | — | — | |
| EASEBackbone=ViT-B/16-IN21K2026.05 | 90.83 | — | — | — | 86.32 | — | — | — | — | — | — | |
| CL-LoRABackbone=ViT-B/16-IN21K2026.05 | 88.98 | — | — | — | 83.75 | — | — | — | — | — | — | |
| CODA-PromptBackbone=ViT-B/16-IN21K2026.05 | 88.17 | — | — | — | 81.36 | — | — | — | — | — | — | |
| InfLoRABackbone=ViT-B/16-IN21K2026.05 | 87.33 | — | — | — | 81.59 | — | — | — | — | — | — | |
| Adaptive Trainingsequence_length=20 tasks2026.02 | 80.81 | — | 45.08 | — | — | — | — | — | — | — | — | |
| RMNBackbone=ResNet-182021.02 | 80.01 | — | — | — | — | — | — | — | — | — | — | |
| Initialized Trainingsequence_length=20 tasks2026.02 | 79.36 | — | 46.68 | — | — | — | — | — | — | — | — | |
| Frozen Trainingsequence_length=20 tasks2026.02 | 78.28 | — | 45.88 | — | — | — | — | — | — | — | — | |
| GD-WILDBackbone=ResNet-18, Requires storing previous data=true2021.03 | 77.16 | -14.85 | — | — | — | — | — | — | — | — | — | |
| Adam-NSCLBackbone=ResNet-18, Requires storing previous data=false2021.03 | 75.95 | -3.66 | — | — | — | — | — | — | — | — | — | |
| LwFBackbone=ResNet-18, Requires storing previous data=false2021.03 | 74.38 | -9.11 | — | — | — | — | — | — | — | — | — | |
| EWCBackbone=ResNet-18, Requires storing previous data=false2021.03 | 71.66 | -3.72 | — | — | — | — | — | — | — | — | — | |
| RWALKBackbone=ResNet-18, Data replay buffer=true, Multiheaded=true, Samples=50002021.02 | 70.1 | — | — | — | — | — | — | — | — | — | — | |
| GEMBackbone=ResNet-18, Requires storing previous data=true2021.03 | 68.89 | -1.2 | — | — | — | — | — | — | — | — | — | |
| OWMBackbone=ResNet-18, Requires storing previous data=false2021.03 | 68.47 | -3.37 | — | — | — | — | — | — | — | — | — | |
| MUC-MASBackbone=ResNet-18, Requires storing previous data=false2021.03 | 67.22 | -5.72 | — | — | — | — | — | — | — | — | — | |
| MEGA-IIBackbone=ResNet-18, Data replay buffer=true, Trained over all tasks=false, Additional model used=true, Points per task=13002021.02 | 66.12 | — | — | — | — | — | — | — | — | — | — | |
| MEGABackbone=ResNet-18, Requires storing previous data=true2021.03 | 64.98 | -5.13 | — | — | — | — | — | — | — | — | — | |
| MASBackbone=ResNet-18, Requires storing previous data=false2021.03 | 63.84 | -6.29 | — | — | — | — | — | — | — | — | — | |
| A-GEMBackbone=ResNet-18, Requires storing previous data=true2021.03 | 61.91 | -6.88 | — | — | — | — | — | — | — | — | — | |
| SIBackbone=ResNet-18, Requires storing previous data=false2021.03 | 59.76 | -8.62 | — | — | — | — | — | — | — | — | — | |
| InstAParamBackbone=ResNet-18, Requires storing previous data=false2021.03 | 51.04 | -4.92 | — | — | — | — | — | — | — | — | — | |
| SIBackbone=ResNet-182021.02 | 45.49 | — | — | — | — | — | — | — | — | — | — | |
| EWCBackbone=ResNet-18, Multiheaded=true2021.02 | 42.67 | — | — | — | — | — | — | — | — | — | — | |
| MASBackbone=ResNet-18, Pretrained network=true, Multiheaded=true2021.02 | 42 | — | — | — | — | — | — | — | — | — | — | |
| Adaptive Training2026.02 | 39.09 | — | 45.08 | 80.81 | — | — | — | — | — | — | — | |
| Initialized Training2026.02 | 37.79 | — | 46.68 | 79.36 | — | — | — | — | — | — | — | |
| Frozen Training2026.02 | 37.59 | — | 45.88 | 78.28 | — | — | — | — | — | — | — | |
| AGS-CLBackbone=ResNet-18, Multiheaded=true2021.02 | 27.6 | — | — | — | — | — | — | — | — | — | — | |
| HATBackbone=ResNet-18, Pretrained network=true, Multiheaded=true2021.02 | 23.6 | — | — | — | — | — | — | — | — | — | — | |
| DER++Phase=3, Samples per task=5002026.05 | 19.03 | — | — | — | — | — | 21.32 | — | — | — | — | |
| ERPhase=3, Samples per task=5002026.05 | 15.96 | — | — | — | — | — | 23.91 | — | — | — | — | |
| DER++Phase=1, Setting=Method comparison2026.05 | 13.46 | -0.5248 | — | — | — | 0.9209 | 17.68 | — | — | — | — | |
| DER++Phase=3, Samples per task=2002026.05 | 13.08 | — | — | — | — | — | 20.62 | — | — | — | — | |
| ERPhase=1, Setting=Method comparison2026.05 | 11.6 | -0.4955 | — | — | — | 0.7644 | 16.1 | — | — | — | — | |
| ERPhase=3, Samples per task=2002026.05 | 11.56 | — | — | — | — | — | 20.74 | — | — | — | — | |
| DER++Phase=3, Samples per task=1002026.05 | 10.8 | — | — | — | — | — | 24.43 | — | — | — | — | |
| ERPhase=3, Samples per task=1002026.05 | 8.97 | — | — | — | — | — | 15.52 | — | — | — | — | |
| DER++Phase=3, Samples per task=502026.05 | 7.12 | — | — | — | — | — | 16.75 | — | — | — | — | |
| ERPhase=3, Samples per task=502026.05 | 5.84 | — | — | — | — | — | 17.15 | — | — | — | — | |
| LwFPhase=1, Setting=Method comparison2026.05 | 4.67 | -0.6925 | — | — | — | 1.5442 | 11.83 | — | — | — | — | |
| FinetunePhase=1, Setting=Method comparison2026.05 | 3.84 | -0.6437 | — | — | — | 5.734 | 11.93 | — | — | — | — | |
| FPR-MidPhase=2, Setting=FPR ablation2026.05 | 3.82 | -0.6582 | — | — | — | 3.4924 | 7.8 | — | — | — | — | |
| FPRPhase=3, Samples per task=1002026.05 | 3.75 | — | — | — | — | — | 5 | — | — | — | — | |
| FPR-TrajPhase=1, Setting=Method comparison2026.05 | 3.74 | -0.6546 | — | — | — | 0.5568 | 3.32 | — | — | — | — | |
| FPR-TrajOnlyPhase=2, Setting=FPR ablation2026.05 | 3.68 | -0.6534 | — | — | — | 13.5703 | 17.77 | — | — | — | — | |
| FPRPhase=3, Samples per task=502026.05 | 3.67 | — | — | — | — | — | 4.47 | — | — | — | — | |
| FPRPhase=3, Samples per task=5002026.05 | 3.61 | — | — | — | — | — | 6 | — | — | — | — | |
| FPR-FullPhase=1, Setting=Method comparison2026.05 | 3.6 | -0.6263 | — | — | — | 1.5758 | 4.04 | — | — | — | — | |
| FPR-FullPhase=2, Setting=FPR ablation2026.05 | 3.53 | -0.636 | — | — | — | 0.4083 | 3.47 | — | — | — | — | |
| FPR-JacPhase=1, Setting=Method comparison2026.05 | 3.45 | -0.5707 | — | — | — | 1.2716 | 5.36 | — | — | — | — | |
| FPR-LatePhase=2, Setting=FPR ablation2026.05 | 3.39 | -0.5223 | — | — | — | 4.3175 | 12.26 | — | — | — | — | |
| FPR-JacOnlyPhase=2, Setting=FPR ablation2026.05 | 3.34 | -0.5735 | — | — | — | 1.9565 | 5.39 | — | — | — | — | |
| FPRPhase=3, Samples per task=2002026.05 | 3.21 | — | — | — | — | — | 4.48 | — | — | — | — | |
| FPR-EarlyPhase=2, Setting=FPR ablation2026.05 | 2.89 | -0.6182 | — | — | — | 2.0783 | 7.43 | — | — | — | — | |
| EWCPhase=1, Setting=Method comparison2026.05 | 1.4 | -0.0921 | — | — | — | 7.2487 | 11.95 | — | — | — | — | |
| DER++ + FPR-FullPhase=4, Samples per task=502026.05 | — | — | — | — | — | — | — | -0.0021 | -0.0218 | -0.2579 | -0.1279 | |
| DER++ + FPR-FullPhase=4, Samples per task=1002026.05 | — | — | — | — | — | — | — | 0.0008 | -0.0429 | -0.1135 | -0.1176 | |
| DER++ + FPR-FullPhase=4, Samples per task=2002026.05 | — | — | — | — | — | — | — | 0.0111 | 0.0571 | -0.2661 | -0.0748 | |
| ER + FPR-LatePhase=4, Samples per task=502026.05 | — | — | — | — | — | — | — | -0.0267 | -0.0581 | 0.5128 | 0.0012 | |
| ER + FPR-LatePhase=4, Samples per task=1002026.05 | — | — | — | — | — | — | — | -0.047 | -0.1027 | 0.4941 | 0.0028 | |
| ER + FPR-LatePhase=4, Samples per task=2002026.05 | — | — | — | — | — | — | — | -0.0461 | -0.1415 | 0.3111 | -0.0207 |