Continual Learning on Standard CL Benchmark
80.28BWT (Avg Order 1-3)SHLPT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SHLPT2024.06 | 80.28 | — | 80.21 | 79.69 | 80.93 | |
| MTLModel=T52025.07 | 80 | — | 80 | 80 | 80 | |
| MTLBase model=T5-large, Reference Type=Multi-task learning Reference2024.10 | 80 | — | 80 | 80 | 80 | |
| GORPModel=T52025.07 | 79.8 | — | 79.7 | 79.9 | 79.7 | |
| CLoRABase model=T5-large2024.10 | 79 | — | 79.7 | 79.1 | 78.2 | |
| N-LORAModel=T52025.07 | 78.8 | — | 79.2 | 78.4 | 78.8 | |
| Per-task Prompts2024.06 | 78.5 | — | 78.5 | 78.5 | 78.5 | |
| CODA-Prompt2024.06 | 77.67 | — | 77.01 | 80.16 | 75.86 | |
| MIGUModel=T52025.07 | 76.6 | — | 77.1 | 77 | 75.6 | |
| ProgPrompt2024.06 | 76.31 | — | 73.73 | 77.06 | 78.13 | |
| O-LORAModel=T52025.07 | 75.8 | — | 75.4 | 75.7 | 76.3 | |
| O-LoRABase model=T5-large2024.10 | 75.8 | — | 75.4 | 75.7 | 76.3 | |
| L2P2024.06 | 75.62 | — | 76.26 | 75.63 | 74.97 | |
| ProgPromptModel=T52025.07 | 75.1 | — | 75.2 | 75.1 | 75.1 | |
| LFPT5Base model=T5-large2024.10 | 72.7 | — | 67.6 | 72.6 | 77.9 | |
| PerTaskFTModel=T52025.07 | 70 | — | 70 | 70 | 70 | |
| PerTaskFTBase model=T5-large, Reference Type=Non-CL Reference2024.10 | 70 | — | 70 | 70 | 70 | |
| LFPT5Model=T52025.07 | 68.3 | — | 65.3 | 68 | 71.5 | |
| ER2024.06 | 67.09 | — | 64.63 | 69.36 | 67.28 | |
| IncLORAModel=T52025.07 | 66.4 | — | 66 | 64.9 | 68.3 | |
| IncLoRABase model=T5-large2024.10 | 66.4 | — | 66 | 64.9 | 68.3 | |
| Online EWC2024.06 | 62.17 | — | 62.82 | 57.31 | 66.37 | |
| L2PModel=T52025.07 | 61 | — | 60.3 | 61.7 | 61.1 | |
| L2PBase model=T5-large2024.10 | 60.7 | — | 60.3 | 61.7 | 61.1 | |
| ReplayModel=T52025.07 | 57.8 | — | 55.2 | 56.9 | 61.3 | |
| ReplayBase model=T5-large2024.10 | 57.8 | — | 55.2 | 56.9 | 61.3 | |
| LwFModel=T52025.07 | 55.5 | — | 50.2 | 52 | 64.3 | |
| LwFBase model=T5-large2024.10 | 52.3 | — | 54.4 | 53.1 | 49.6 | |
| EWCModel=T52025.07 | 50.3 | — | 48.7 | 47.7 | 54.5 | |
| EWCBase model=T5-large2024.10 | 50.3 | — | 48.7 | 47.7 | 54.5 | |
| SeqLORAModel=T52025.07 | 43.7 | — | 44.6 | 32.7 | 53.7 | |
| SeqLoRABase model=T5-large2024.10 | 43.7 | — | 44.6 | 32.7 | 53.7 | |
| Finetune2024.06 | 33.04 | — | 30.92 | 32.27 | 35.94 | |
| SeqFTModel=T52025.07 | 28.5 | — | 18.9 | 24.9 | 41.7 | |
| SeqFTBase model=T5-large2024.10 | 28.5 | — | 18.9 | 24.9 | 41.7 | |
| GORPBackbone=T52025.07 | -0.8 | -4.3 | — | — | — | |
| N-LoRABackbone=T52025.07 | -4.9 | -6.5 | — | — | — | |
| O-LoRABackbone=T52025.07 | -7.8 | -16.4 | — | — | — |