Continual Learning on CTrL S+ stream
65.3AccuracyER
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| ERNumber of Modules (M)=4, Fixed Capacity=true, Task-ID Agnostic=true, Single-head (S)=true2021.11 | 65.3 | 6 | |
| EXPERTSNumber of Modules (M)=24, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 63.2 | 0 | |
| ERNumber of Modules (M)=4, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 63 | 3.8 | |
| MNTDPNumber of Modules (M)=21.0, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 62.6 | 0 | |
| LMCNumber of Modules (M)=22.3, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 62.2 | 2.3 | |
| SG-FNumber of Modules (M)=20.8, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 61.5 | 0 | |
| HATNumber of Modules (M)=24, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 61.4 | -0.2 | |
| LMCNumber of Modules (M)=21.3, Fixed Capacity=false, Task-ID Agnostic=false, Variant=-A2021.11 | 60.1 | -1.4 | |
| LMCNumber of Modules (M)=15.3, Fixed Capacity=false, Task-ID Agnostic=true, Hard Module Selection (H)=true2021.11 | 55.8 | -0.3 | |
| O-EWCNumber of Modules (M)=24, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 54.6 | -1.3 | |
| EWCNumber of Modules (M)=24, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 53.4 | -2.3 | |
| MNTDPNumber of Modules (M)=20.7, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 43.2 | -10.8 | |
| FINETUNE LNumber of Modules (M)=24, Fixed Capacity=true2021.11 | 38.2 | -25.8 | |
| FINETUNENumber of Modules (M)=4, Fixed Capacity=true2021.11 | 31.4 | -29.3 | |
| SG-FNumber of Modules (M)=16.0, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 20.4 | -39.3 |