Class-Incremental Learning on Split ImageNet-R 10 incremental tasks
82.38Class AccuracySoft-TF-L[10,11,12]
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Soft-TF-L[10,11,12]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Gradient ID2024.11 | 82.38 | — | 0.59 | 15.35 | 82 | — | — | |
| Soft-TF-L[3,4,5]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Gradient ID2024.11 | 82.15 | — | 2.2 | 15.35 | 82 | — | — | |
| Upper-Bound of Soft-TFBackbone=ViT-B/16, #Tr.Params.=6.93M2024.11 | 80.21 | — | — | — | — | — | — | |
| Upper-Bound of DualPromptBackbone=ViT-B/16, #Tr.Params.=0.03M2024.11 | 79.13 | — | — | — | — | — | — | |
| Soft-TF-L[10,11,12]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Prompt ID2024.11 | 76.62 | — | 5.3 | 15.35 | 52 | — | — | |
| HiDe-PromptPTM=Sup-21K, Backbone=ViT-B/162023.10 | 76.6 | 75.06 | 2.17 | — | — | — | — | |
| Soft-TF-L[3,4,5]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Prompt ID2024.11 | 74.7 | — | 6.46 | 15.35 | 52 | — | — | |
| CODA-PromptPTM=Sup-21K, Backbone=ViT-B/162023.10 | 74.26 | 70.03 | 5.17 | — | — | — | — | |
| HiDe-PromptPTM=iBOT-1K, Backbone=ViT-B/162023.10 | 73.62 | 71.33 | 2.79 | — | — | — | — | |
| HiDe-PromptPTM=iBOT-21K, Backbone=ViT-B/162023.10 | 73.23 | 70.83 | 2.46 | — | — | — | — | |
| CODA-PromptPTM=iBOT-1K, Backbone=ViT-B/162023.10 | 73.14 | 66.56 | 7.22 | — | — | — | — | |
| S-Prompt++PTM=Sup-21K, Backbone=ViT-B/162023.10 | 72.5 | 69.68 | 3.29 | — | — | — | — | |
| DualPromptPTM=Sup-21K, Backbone=ViT-B/162023.10 | 71.96 | 68.79 | 4.49 | — | — | — | — | |
| HiDe-PromptPTM=DINO-1K, Backbone=ViT-B/162023.10 | 71.7 | 68.11 | 3.11 | — | — | — | — | |
| CODA-PromptPTM=DINO-1K, Backbone=ViT-B/162023.10 | 69.73 | 63.15 | 6.86 | — | — | — | — | |
| HiDe-PromptPTM=MoCo-1K, Backbone=ViT-B/162023.10 | 68.26 | 63.77 | 3.57 | — | — | — | — | |
| DualPrompt*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 68.13 | — | 4.46 | 13.1 | 47 | — | — | |
| L2PPTM=Sup-21K, Backbone=ViT-B/162023.10 | 67.25 | 63.65 | 7.51 | — | — | — | — | |
| DualPromptPTM=iBOT-1K, Backbone=ViT-B/162023.10 | 67.11 | 61.51 | 5.02 | — | — | — | — | |
| CODA-PromptPTM=iBOT-21K, Backbone=ViT-B/162023.10 | 66.76 | 61.22 | 9.66 | — | — | — | — | |
| DER++Backbone=ViT-B/16, #Tr.Params.=5,000, Task ID=-2024.11 | 66.73 | — | — | 20.67 | — | — | — | |
| S-Prompt++PTM=iBOT-1K, Backbone=ViT-B/162023.10 | 66.03 | 60.82 | 4.16 | — | — | — | — | |
| L2PPTM=iBOT-1K, Backbone=ViT-B/162023.10 | 65.95 | 60.97 | 4.07 | — | — | — | — | |
| CODA-PromptPTM=MoCo-1K, Backbone=ViT-B/162023.10 | 65.49 | 55.75 | 10.46 | — | — | — | — | |
| DualPromptPTM=DINO-1K, Backbone=ViT-B/162023.10 | 64.89 | 58.57 | 5.8 | — | — | — | — | |
| BiCBackbone=ViT-B/16, #Tr.Params.=5,000, Task ID=-2024.11 | 64.63 | — | — | 22.25 | — | — | — | |
| S-Prompt++PTM=DINO-1K, Backbone=ViT-B/162023.10 | 63.79 | 57.64 | 5.08 | — | — | — | — | |
| + PGP*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 63.34 | — | 4.53 | 13.33 | 47 | — | — | |
| L2PPTM=DINO-1K, Backbone=ViT-B/162023.10 | 62.56 | 57.4 | 3.58 | — | — | — | — | |
| DualPromptPTM=MoCo-1K, Backbone=ViT-B/162023.10 | 60.65 | 52.57 | 2.73 | — | — | — | — | |
| S-Prompt++PTM=MoCo-1K, Backbone=ViT-B/162023.10 | 60.03 | 53.15 | 4.11 | — | — | — | — | |
| L2PPTM=MoCo-1K, Backbone=ViT-B/162023.10 | 58.87 | 51.64 | 2.37 | — | — | — | — | |
| DualPromptPTM=iBOT-21K, Backbone=ViT-B/162023.10 | 58.69 | 54.55 | 5.38 | — | — | — | — | |
| L2PPTM=iBOT-21K, Backbone=ViT-B/162023.10 | 58.62 | 55.35 | 3.73 | — | — | — | — | |
| S-Prompt++PTM=iBOT-21K, Backbone=ViT-B/162023.10 | 58.48 | 55.16 | 4.07 | — | — | — | — | |
| DER++Backbone=ViT-B/16, #Tr.Params.=1,000, Task ID=-2024.11 | 55.47 | — | — | 34.64 | — | — | — | |
| BiCBackbone=ViT-B/16, #Tr.Params.=1,000, Task ID=-2024.11 | 52.14 | — | — | 36.7 | — | — | — | |
| LWFBackbone=ViT-B/16, #Tr.Params.=-, Task ID=-2024.11 | 38.54 | — | — | 52.37 | — | — | — | |
| EWCBackbone=ViT-B/16, #Tr.Params.=-, Task ID=-2024.11 | 35 | — | — | 56.16 | — | — | — | |
| FTBackbone=ViT-B/16, #Tr.Params.=-, Task ID=-2024.11 | 28.87 | — | — | 63.8 | — | — | — | |
| DERBackbone=ViT-B/16-IN21K2026.05 | — | 80.48 | — | — | — | 20 | 74.32 | |
| FOSTERBackbone=ViT-B/16-IN21K2026.05 | — | 81.34 | — | — | — | 20 | 74.48 | |
| iCaRLBackbone=ViT-B/16-IN21K2026.05 | — | 72.42 | — | — | — | 20 | 60.67 | |
| MEMOBackbone=ViT-B/16-IN21K2026.05 | — | 74.8 | — | — | — | 20 | 66.62 | |
| SEMA (Base)Backbone=ViT-B/16-IN21K2026.05 | — | 80.51 | — | — | — | 0 | 73.83 | |
| SEMA + OursBackbone=ViT-B/16-IN21K2026.05 | — | 81.7 | — | — | — | 18.87 | 75.95 |