Continual Learning on CTrL S- stream
69.5AccuracyLMC
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LMCNumber of Modules (M)=20.0, Fixed Capacity=false, Task-ID Agnostic=false, Variant=-A2021.11 | 69.5 | 0 | |
| LMCNumber of Modules (M)=19.7, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 68.5 | -0.1 | |
| MNTDPNumber of Modules (M)=16.0, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 67.9 | 0 | |
| LMCNumber of Modules (M)=21.5, Fixed Capacity=false, Task-ID Agnostic=true, Hard Module Selection (H)=true2021.11 | 67.6 | -0.8 | |
| LMCNumber of Modules (M)=15.7, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 67.2 | -0.5 | |
| LMCNumber of Modules (M)=15.3, Fixed Capacity=false, Task-ID Agnostic=false, Variant=-A2021.11 | 66.6 | 0 | |
| MNTDPNumber of Modules (M)=13.7, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 66.3 | 0 | |
| SG-FNumber of Modules (M)=17.5, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 65.5 | 0 | |
| LMCNumber of Modules (M)=16.2, Fixed Capacity=false, Task-ID Agnostic=true, Hard Module Selection (H)=true2021.11 | 64.9 | -0.2 | |
| ERNumber of Modules (M)=4, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 63.8 | -1.9 | |
| HATNumber of Modules (M)=24, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 63.7 | -1.3 | |
| SG-FNumber of Modules (M)=14.7, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 63.6 | 0 | |
| EXPERTSNumber of Modules (M)=24, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 63.1 | 0 | |
| EWCNumber of Modules (M)=24, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 62.7 | -3.6 | |
| EXPERTSNumber of Modules (M)=24, Fixed Capacity=false, Task-ID Agnostic=false2021.11 | 62.7 | 0 | |
| O-EWCNumber of Modules (M)=24, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 62 | -3.2 | |
| ERNumber of Modules (M)=4, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 60.6 | -2.1 | |
| ERNumber of Modules (M)=4, Fixed Capacity=true, Task-ID Agnostic=true, Single-head (S)=true2021.11 | 60.4 | -0.5 | |
| ERNumber of Modules (M)=4, Fixed Capacity=true, Task-ID Agnostic=true, Single-head (S)=true2021.11 | 58.8 | -4.2 | |
| EWCNumber of Modules (M)=24, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 56.3 | -9.1 | |
| O-EWCNumber of Modules (M)=24, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 54.2 | -10.8 | |
| FINETUNE LNumber of Modules (M)=24, Fixed Capacity=true2021.11 | 52.1 | -15.7 | |
| HATNumber of Modules (M)=24, Fixed Capacity=true, Task-ID Agnostic=false2021.11 | 50.1 | 0 | |
| FINETUNE LNumber of Modules (M)=24, Fixed Capacity=true2021.11 | 49.3 | -18.4 | |
| FINETUNENumber of Modules (M)=4, Fixed Capacity=true2021.11 | 47.5 | -14.9 | |
| MNTDPNumber of Modules (M)=14.8, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 41.9 | -2.8 | |
| FINETUNENumber of Modules (M)=4, Fixed Capacity=true2021.11 | 39.7 | -23.9 | |
| MNTDPNumber of Modules (M)=17.2, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 32.7 | -15.2 | |
| SG-FNumber of Modules (M)=14.3, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 29.5 | -35.3 | |
| SG-FNumber of Modules (M)=18.7, Fixed Capacity=false, Task-ID Agnostic=true2021.11 | 24.4 | -38.7 |