Continual Learning on ImageNet-R
1.8Average ForgettingTRM
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| TRMNumber of Tasks=5, Method Category=Ours2026.05 | 1.8 | — | — | — | — | — | |
| RAPFNumber of Tasks=5, Method Category=PEFT2026.05 | 2.1 | — | — | — | — | — | |
| CODAPromptNumber of Tasks=5, Method Category=PEFT2026.05 | 2.5 | — | — | — | — | — | |
| CLG-CBMNumber of Tasks=5, Method Category=PEFT2026.05 | 2.6 | — | — | — | — | — | |
| TRMNumber of Tasks=10, Method Category=Ours2026.05 | 2.6 | — | — | — | — | — | |
| DualPromptNumber of Tasks=5, Method Category=PEFT2026.05 | 2.8 | — | — | — | — | — | |
| L2PNumber of Tasks=5, Method Category=PEFT2026.05 | 3.1 | — | — | — | — | — | |
| BECAMENumber of Tasks=5, Method Category=Model Merging2026.05 | 3.1 | — | — | — | — | — | |
| RAPFNumber of Tasks=10, Method Category=PEFT2026.05 | 3.2 | — | — | — | — | — | |
| MagMaxNumber of Tasks=5, Method Category=Model Merging2026.05 | 3.4 | — | — | — | — | — | |
| TRMNumber of Tasks=20, Method Category=Ours2026.05 | 3.5 | — | — | — | — | — | |
| PMNumber of Tasks=5, Method Category=Model Merging2026.05 | 3.6 | — | — | — | — | — | |
| CODAPromptNumber of Tasks=10, Method Category=PEFT2026.05 | 3.8 | — | — | — | — | — | |
| CLG-CBMNumber of Tasks=10, Method Category=PEFT2026.05 | 3.9 | — | — | — | — | — | |
| TIESNumber of Tasks=5, Method Category=Model Merging2026.05 | 3.9 | — | — | — | — | — | |
| DualPromptNumber of Tasks=10, Method Category=PEFT2026.05 | 4.1 | — | — | — | — | — | |
| RAPFNumber of Tasks=20, Method Category=PEFT2026.05 | 4.4 | — | — | — | — | — | |
| L2PNumber of Tasks=10, Method Category=PEFT2026.05 | 4.5 | — | — | — | — | — | |
| Model StockNumber of Tasks=5, Method Category=Model Merging2026.05 | 4.6 | — | — | — | — | — | |
| BECAMENumber of Tasks=10, Method Category=Model Merging2026.05 | 4.6 | — | — | — | — | — | |
| CODAPromptNumber of Tasks=20, Method Category=PEFT2026.05 | 4.9 | — | — | — | — | — | |
| MagMaxNumber of Tasks=10, Method Category=Model Merging2026.05 | 4.9 | — | — | — | — | — | |
| PMNumber of Tasks=10, Method Category=Model Merging2026.05 | 5 | — | — | — | — | — | |
| CLG-CBMNumber of Tasks=20, Method Category=PEFT2026.05 | 5.1 | — | — | — | — | — | |
| DualPromptNumber of Tasks=20, Method Category=PEFT2026.05 | 5.2 | — | — | — | — | — | |
| TIESNumber of Tasks=10, Method Category=Model Merging2026.05 | 5.4 | — | — | — | — | — | |
| L2PNumber of Tasks=20, Method Category=PEFT2026.05 | 5.8 | — | — | — | — | — | |
| BECAMENumber of Tasks=20, Method Category=Model Merging2026.05 | 6.2 | — | — | — | — | — | |
| MagMaxNumber of Tasks=20, Method Category=Model Merging2026.05 | 6.5 | — | — | — | — | — | |
| Model StockNumber of Tasks=10, Method Category=Model Merging2026.05 | 6.8 | — | — | — | — | — | |
| PMNumber of Tasks=20, Method Category=Model Merging2026.05 | 6.8 | — | — | — | — | — | |
| TIESNumber of Tasks=20, Method Category=Model Merging2026.05 | 7.1 | — | — | — | — | — | |
| Model StockNumber of Tasks=20, Method Category=Model Merging2026.05 | 8.5 | — | — | — | — | — | |
| EWCNumber of Tasks=5, Method Category=Conv.2026.05 | 10.2 | — | — | — | — | — | |
| LwFNumber of Tasks=5, Method Category=Conv.2026.05 | 15.3 | — | — | — | — | — | |
| EWCNumber of Tasks=10, Method Category=Conv.2026.05 | 16.7 | — | — | — | — | — | |
| LwFNumber of Tasks=10, Method Category=Conv.2026.05 | 19.8 | — | — | — | — | — | |
| EWCNumber of Tasks=20, Method Category=Conv.2026.05 | 22.8 | — | — | — | — | — | |
| LwFNumber of Tasks=20, Method Category=Conv.2026.05 | 24.1 | — | — | — | — | — | |
| AttriCLIP2024.03 | — | -0.082 | — | — | — | — | |
| C-Prompt2026.04 | — | — | — | — | 53.32 | 13.52 | |
| CLAP4CLIPbase_method=Continual-CLIP2024.03 | — | -0.107 | — | — | — | — | |
| CLAP4CLIPbase_method=CoOp2024.03 | — | -0.112 | — | — | — | — | |
| CLAP4CLIPbase_method=MaPLe2024.03 | — | -0.093 | — | — | — | — | |
| CLAP4CLIPbase_method=AttriCLIP2024.03 | — | -0.092 | — | — | — | — | |
| CODA-P2024.03 | — | — | 0.32 | — | — | — | |
| CODA-PType=Expandable Param Size, Params (M)=3.9942024.03 | — | — | — | 70.02 | — | — | |
| CODA-Prompt2026.04 | — | — | — | — | 50.24 | 13.5 | |
| Continual-CLIP2024.03 | — | -0.066 | — | — | — | — | |
| CoOp2024.03 | — | -0.12 | — | — | — | — | |
| CPS-Prompt2026.04 | — | — | — | — | 49.96 | 11.06 | |
| DualPrompt2024.03 | — | — | 0.25 | — | — | — | |
| DualPromptType=Expandable Param Size, Params (M)=1.0982024.03 | — | — | — | 61.97 | — | — | |
| DualPrompt2026.04 | — | — | — | — | 46.6 | 11.42 | |
| ER2026.04 | — | — | — | — | 19.57 | 67.96 | |
| EWCSetting=CIL2026.05 | — | — | — | — | 63.5 | — | |
| EWCSetting=DIL2026.05 | — | — | — | — | 65.1 | — | |
| JointBackbone=ViT-B16, Pre-training=ImageNet21K, Evaluation Protocol=Offline, Initial Classes=2, New Classes per Task=12024.02 | — | — | — | — | 86.6 | — | |
| L2P2024.03 | — | — | 0.27 | — | — | — | |
| L2PType=Fixed Param Size, Params (M)=0.2002024.03 | — | — | — | 62.9 | — | — | |
| L2P2026.04 | — | — | — | — | 45.08 | 8.28 | |
| LwF2026.04 | — | — | — | — | 7.64 | 74.2 | |
| LwFSetting=CIL2026.05 | — | — | — | — | 58.2 | — | |
| LwFSetting=DIL2026.05 | — | — | — | — | 61.7 | — | |
| MagMaxSetting=CIL2026.05 | — | — | — | — | 80 | — | |
| MagMaxSetting=DIL2026.05 | — | — | — | — | 83.9 | — | |
| MaPLe2024.03 | — | -0.1 | — | — | — | — | |
| Model StockSetting=CIL2026.05 | — | — | — | — | 77 | — | |
| Model StockSetting=DIL2026.05 | — | — | — | — | 82.6 | — | |
| OS-Prompt2026.04 | — | — | — | — | 50.3 | 14.49 | |
| OS-Prompt++2026.04 | — | — | — | — | 50.3 | 11.71 | |
| RanDumbBackbone=ViT-B16, Pre-training=ImageNet21K, Evaluation Protocol=Offline, Initial Classes=2, New Classes per Task=12024.02 | — | — | — | — | 64.9 | — | |
| RanPAC-impBackbone=ViT-B16, Pre-training=ImageNet21K, Evaluation Protocol=Offline, Initial Classes=2, New Classes per Task=12024.02 | — | — | — | — | 69.4 | — | |
| SEMAcomponent=Overall2024.03 | — | — | 0.11 | — | — | — | |
| SEMAcomponent=Adapter2024.03 | — | — | 0.1 | — | — | — | |
| SEMAcomponent=RD2024.03 | — | — | 0.01 | — | — | — | |
| SEMAType=Expandable Param Size, Params (M)=0.6172024.03 | — | — | — | 74.53 | — | — | |
| SGD2026.04 | — | — | — | — | 7.5 | 76.56 | |
| SLCABackbone=ViT-B16, Pre-training=ImageNet21K, Evaluation Protocol=Offline, Initial Classes=2, New Classes per Task=12024.02 | — | — | — | — | 54.2 | — | |
| TIESSetting=CIL2026.05 | — | — | — | — | 78.8 | — | |
| TIESSetting=DIL2026.05 | — | — | — | — | 83.5 | — | |
| TRMSetting=CIL2026.05 | — | — | — | — | 83.1 | — | |
| TRMSetting=DIL2026.05 | — | — | — | — | 84.9 | — | |
| Upper-Bound2026.04 | — | — | — | — | 63.04 | — |