Continual Learning on CTrL Spl stream
64AccuracyMNTDP
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MNTDPNumber of Modules (M)=17.2, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 64 | 0 | |
| EXPERTSNumber of Modules (M)=20, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 63.9 | 0 | |
| LMCNumber of Modules (M)=19.0, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 63.5 | -1 | |
| SG-FNumber of Modules (M)=16.0, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 62 | 0 | |
| LMCNumber of Modules (M)=18.2, Fixed Capacity=false, Task-ID Agnostic=false, Variant=-A2021.11 | 61.6 | -3.5 | |
| HATNumber of Modules (M)=20, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 61.2 | -0.1 | |
| ERNumber of Modules (M)=4, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 60.5 | 0.5 | |
| ERNumber of Modules (M)=4, Fixed Capacity=true, Task-ID Agnostic=true, Single-head (S)=true2021.11 | 58.6 | -1.2 | |
| EWCNumber of Modules (M)=20, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 54.2 | -4.2 | |
| LMCNumber of Modules (M)=10.8, Fixed Capacity=false, Task-ID Agnostic=true, Hard Module Selection (H)=true2021.11 | 53.8 | 3.1 | |
| O-EWCNumber of Modules (M)=20, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 52.3 | -5.7 | |
| FINETUNE LNumber of Modules (M)=20, Fixed Capacity=true2021.11 | 37.1 | -26 | |
| MNTDPNumber of Modules (M)=15.8, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 35.1 | -16.4 | |
| FINETUNENumber of Modules (M)=4, Fixed Capacity=true2021.11 | 29.1 | -29.2 | |
| SG-FNumber of Modules (M)=15.5, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 19.4 | -41.8 |