Continual Learning on CTrL Sout stream
66.7AccuracyLMC
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LMCNumber of Modules (M)=15.5, Fixed Capacity=false, Task-ID Agnostic=false, Variant=-A2021.11 | 66.7 | -0.1 | |
| MNTDPNumber of Modules (M)=15.0, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 65.8 | 0 | |
| SG-FNumber of Modules (M)=16.2, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 64.1 | 0 | |
| EXPERTSNumber of Modules (M)=24, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 63.1 | 0 | |
| EWCNumber of Modules (M)=24, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 62.5 | -3.6 | |
| O-EWCNumber of Modules (M)=24, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 62.4 | -3 | |
| HATNumber of Modules (M)=24, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 61.9 | -3.2 | |
| ERNumber of Modules (M)=4, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 60.7 | -1.5 | |
| LMCNumber of Modules (M)=15.5, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 55.1 | -7.1 | |
| LMCNumber of Modules (M)=15.9, Fixed Capacity=false, Task-ID Agnostic=true, Hard Module Selection (H)=true2021.11 | 54.2 | -2.9 | |
| FINETUNE LNumber of Modules (M)=24, Fixed Capacity=true2021.11 | 49.3 | -18.4 | |
| ERNumber of Modules (M)=4, Fixed Capacity=true, Task-ID Agnostic=true, Single-head (S)=true2021.11 | 47.6 | -7.6 | |
| FINETUNENumber of Modules (M)=4, Fixed Capacity=true2021.11 | 45.4 | -15.5 | |
| MNTDPNumber of Modules (M)=13.3, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 37.9 | -5.8 | |
| SG-FNumber of Modules (M)=12.2, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 30.5 | -34 |