Continual Learning on Large Number of Tasks (test)
-2.9Backward Transfer (BWT)SAPT-LoRA
Evaluation Results
| Method | Links | |
|---|---|---|
| SAPT-LoRAModel=Llama-2-7B-chat2025.12 | -2.9 | |
| SLAOModel=Llama-2-7B-chat2025.12 | -3.5 | |
| MagMaxModel=Llama-2-7B-chat2025.12 | -3.8 | |
| OPCMModel=Llama-2-7B-chat2025.12 | -3.9 | |
| O-LoRAModel=Llama-2-7B-chat2025.12 | -4 | |
| LoRM-ABModel=Llama-2-7B-chat2025.12 | -4.1 | |
| CorDAModel=Llama-2-7B-chat2025.12 | -4.5 | |
| InfLoRAModel=Llama-2-7B-chat2025.12 | -4.9 | |
| LoRM-BAModel=Llama-2-7B-chat2025.12 | -6.7 | |
| IncLoRAModel=Llama-2-7B-chat2025.12 | -9.6 | |
| KnOTSModel=Llama-2-7B-chat, initialization=zero init2025.12 | -14.1 | |
| LoRA-LEGOModel=Llama-2-7B-chat2025.12 | -15.6 | |
| SeqLoRAModel=Llama-2-7B-chat2025.12 | -17.2 |