Class Incremental Learning on CIFAR100 20-Split
99.05AccuracySoft-TF-L[10,11,12]
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Soft-TF-L[10,11,12]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Gradient ID2024.11 | 99.05 | 0.24 | 15.6 | 163 | |
| NoRGa* + Soft-TF-L[10,11,12]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Prompt ID2024.11 | 98.3 | 0.3 | 15.6 | 104 | |
| NoRGa* + Soft-TF-L[10,11,12] (SOTA)Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Prompt ID2024.11 | 98.3 | 0.3 | 15.6 | 104 | |
| Joint of NoRGa+Soft-TFBackbone=ViT-B/16, #Tr.Params.=6.93M2024.11 | 98.2 | — | — | — | |
| Soft-TF-L[10,11,12]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Prompt ID2024.11 | 97.4 | 0.57 | 15.6 | 104 | |
| DualPrompt* + Soft-TF-L[10,11,12]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Prompt ID2024.11 | 97.4 | 0.57 | 15.6 | 104 | |
| DualPrompt* + Soft-TF-L[10,11,12]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Prompt ID2024.11 | 97.4 | 0.57 | 15.6 | 104 | |
| NoRGa*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 97.39 | 0.58 | 11.6 | 78 | |
| NoRGa*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 97.39 | 0.58 | 11.6 | 78 | |
| Upper-Bound of Soft-TFBackbone=ViT-B/16, #Tr.Params.=6.93M2024.11 | 95.9 | — | — | — | |
| Joint of DualPrompt+Soft-TFBackbone=ViT-B/16, #Tr.Params.=6.93M2024.11 | 95.9 | — | — | — | |
| Soft-TF-L[3,4,5]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Gradient ID2024.11 | 95.38 | 1.73 | 15.6 | 163 | |
| Soft-TF-L[3,4,5]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Prompt ID2024.11 | 94.43 | 2.02 | 15.6 | 104 | |
| HiDe-Prompt*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 94.28 | 1.78 | 11.6 | 78 | |
| DualPrompt* + LoRABackbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Prompt ID2024.11 | 92.14 | 2.02 | 15.89 | 105 | |
| Upper-Bound of DualPromptBackbone=ViT-B/16, #Tr.Params.=0.03M2024.11 | 90.85 | — | — | — | |
| Joint of DualPromptBackbone=ViT-B/16, #Tr.Params.=0.13M2024.11 | 90.85 | — | — | — | |
| S-Prompt*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 84.9 | 7.05 | 11.6 | 78 | |
| CODA-Prompt*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 84.7 | 7.11 | 11.6 | 78 | |
| DualPrompt* + AdapterBackbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Prompt ID2024.11 | 84.48 | 5.81 | 16.13 | 109 | |
| + PGP*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 83.74 | 7.91 | 13.12 | 78 | |
| DualPrompt* + PGP*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 83.74 | 7.91 | 13.12 | 78 | |
| DualPrompt*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 82.98 | 8.2 | 11.6 | 78 | |
| DualPrompt*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 82.98 | 8.2 | 11.6 | 78 | |
| DualPrompt*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 82.98 | 8.2 | 11.6 | 78 | |
| iCaRLBackbone=ViT-B/16, #Tr.Params.=5,000, Task ID=-2024.11 | 78.02 | — | 5.8 | — | |
| L2P* + Soft-TF-L[3,4,5]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Prompt ID2024.11 | 76.17 | 15.77 | 13.98 | 100 | |
| L2P* + Soft-TF-L[3,4,5]Backbone=ViT-B/16, #Tr.Params.=6.93M, Task ID=Prompt ID2024.11 | 76.17 | 15.77 | 13.98 | 100 | |
| L2P* + PGP*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 76.12 | 13.26 | 12.7 | 76 | |
| BiCBackbone=ViT-B/16, #Tr.Params.=5,000, Task ID=-2024.11 | 73.02 | — | 6.23 | — | |
| iCaRLBackbone=ViT-B/16, #Tr.Params.=1,000, Task ID=-2024.11 | 71.32 | — | 15.98 | — | |
| L2P*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 71.29 | 13.96 | 11.5 | 76 | |
| L2P*Backbone=ViT-B/16, #Tr.Params.=0.03M, Task ID=Prompt ID2024.11 | 71.29 | 13.96 | 11.5 | 76 | |
| DER+MCGBackbone=ViT-B/16, #Tr.Params.=2,000, Task ID=-2024.11 | 65.84 | — | 13.72 | — | |
| BiCBackbone=ViT-B/16, #Tr.Params.=1,000, Task ID=-2024.11 | 63.12 | — | 21.89 | — | |
| LWFBackbone=ViT-B/16, #Tr.Params.=-, Task ID=-2024.11 | 39.12 | — | 57.91 | — | |
| EWCBackbone=ViT-B/16, #Tr.Params.=-, Task ID=-2024.11 | 36.73 | — | 35.19 | — | |
| FTBackbone=ViT-B/16, #Tr.Params.=-, Task ID=-2024.11 | 33.52 | — | 53.69 | — |