Continual Learning on Large Number of Tasks (Order 4-6)
81.9Average PerformanceSPAT-LoRA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SPAT-LoRABackbone=Llama-2-7B-chat2025.12 | 81.9 | 84.7 | 78.9 | 82.2 | |
| ProgPromptBackbone=T52025.11 | 78.4 | 78.7 | 78.8 | 77.8 | |
| PerTaskFTModel=T52025.07 | 78.1 | 78.1 | 78.1 | 78.1 | |
| PerTaskFTBackbone=T52025.11 | 78.1 | 78.1 | 78.1 | 78.1 | |
| Multi-TaskBackbone=Llama-2-7B-chat2025.12 | 78.1 | — | — | — | |
| ProgPromptModel=T52025.07 | 78 | 78.3 | 77.9 | 77.9 | |
| SHLPT2024.06 | 77.49 | 77.62 | 76.97 | 77.87 | |
| CODA-Prompt2024.06 | 76.54 | 76.21 | 77.02 | 76.4 | |
| MTLModel=T52025.07 | 76.5 | 76.5 | 76.5 | 76.5 | |
| MTLBackbone=T52025.11 | 76.3 | 76.3 | 76.3 | 76.3 | |
| GORPModel=T52025.07 | 76 | 76.1 | 76.2 | 75.6 | |
| Per-task Prompts2024.06 | 75.51 | 75.51 | 75.51 | 75.51 | |
| Slow Surprise ReplayBackbone=T5, Architecture=Dual Learner2025.11 | 75.1 | 75.6 | 74.8 | 75 | |
| SLAOBackbone=Llama-2-7B-chat2025.12 | 74.8 | 75 | 74.4 | 75.1 | |
| L2P2024.06 | 73.87 | 73.86 | 73.67 | 74.07 | |
| O-LoRABackbone=Llama-2-7B-chat2025.12 | 73.5 | 74 | 72 | 74.6 | |
| CorDABackbone=Llama-2-7B-chat2025.12 | 73.4 | 73.4 | 72.7 | 74 | |
| MagMaxBackbone=Llama-2-7B-chat2025.12 | 73.4 | 72.3 | 73.5 | 74.5 | |
| ProgPrompt2024.06 | 72.58 | 73.71 | 72.52 | 71.51 | |
| Slow Reservoir ReplayBackbone=T5, Architecture=Dual Learner2025.11 | 72.5 | 74 | 71.9 | 71.6 | |
| IncLoRABackbone=Llama-2-7B-chat2025.12 | 72.5 | 72.2 | 71.6 | 73.8 | |
| N-LORAModel=T52025.07 | 72.4 | 73.6 | 70.3 | 73.2 | |
| LFPT5Model=T52025.07 | 72.3 | 70 | 73 | 73.8 | |
| Surprise ReplayBackbone=T52025.11 | 72.1 | 72.8 | 72.1 | 71.6 | |
| LoRM-BABackbone=Llama-2-7B-chat2025.12 | 70.2 | 71.4 | 69 | 70.3 | |
| LoRM-ABBackbone=Llama-2-7B-chat2025.12 | 70.2 | 71 | 69.5 | 70.2 | |
| MIGUModel=T52025.07 | 70 | 67.3 | 68.5 | 74.2 | |
| InfLoRABackbone=Llama-2-7B-chat2025.12 | 69.8 | 69.4 | 67.4 | 72.5 | |
| MoRABackbone=T52025.11 | 69.7 | 68.9 | 68.3 | 72 | |
| O-LORAModel=T52025.07 | 69.6 | 72.3 | 64.8 | 71.6 | |
| LB-CLBackbone=T52025.11 | 69.2 | 68.4 | 67.3 | 71.8 | |
| Reservoir ReplayBackbone=T52025.11 | 69.1 | 69.6 | 69.4 | 68.3 | |
| O-LoRABackbone=T52025.11 | 68.8 | 70 | 65.5 | 70.5 | |
| SeqLoRABackbone=Llama-2-7B-chat2025.12 | 68.7 | 69.1 | 66 | 71.1 | |
| KnOTSBackbone=Llama-2-7B-chat2025.12 | 59.9 | 61.5 | 60.1 | 58 | |
| ER2024.06 | 56.9 | 60.34 | 55.98 | 54.37 | |
| LoRA-LEGOBackbone=Llama-2-7B-chat2025.12 | 56.9 | 58.8 | 58.7 | 53.2 | |
| IncLORAModel=T52025.07 | 56.7 | 54.7 | 53.2 | 62.2 | |
| L2PModel=T52025.07 | 56.6 | 56.9 | 56.9 | 56.1 | |
| OPCMBackbone=Llama-2-7B-chat2025.12 | 50.5 | 51.9 | 52.8 | 46.9 | |
| LwFModel=T52025.07 | 49.9 | 49.9 | 50.5 | 49.5 | |
| Online EWC2024.06 | 49.38 | 49.7 | 49.82 | 48.61 | |
| EWCModel=T52025.07 | 46 | 46.9 | 45.6 | 45.6 | |
| ReplayModel=T52025.07 | 45.4 | 44.5 | 46.5 | 45.1 | |
| EWCBackbone=T52025.11 | 44.8 | 44.9 | 44 | 45.4 | |
| Finetune2024.06 | 13.12 | 13.4 | 11.58 | 14.38 | |
| SeqFTModel=T52025.07 | 7.4 | 7.5 | 7.4 | 7.5 | |
| SeqFTBackbone=T52025.11 | 7.4 | 7.4 | 7.3 | 7.4 | |
| SeqLoRABackbone=T52025.11 | 4.2 | 4.9 | 3.5 | 4.2 | |
| SeqLORAModel=T52025.07 | 1.8 | 2 | 1.9 | 1.6 |