Continual Learning on SuperNI Large Number of Tasks (test)
82.1Average PerformanceSPAT-LoRA
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| SPAT-LoRABackbone=Llama-2-13B-chat2025.12 | 82.1 | 83.9 | 80.2 | 82.3 | |
| Multi-TaskBackbone=Llama-2-13B-chat2025.12 | 79.2 | — | — | — | |
| SLAOBackbone=Llama-2-13B-chat2025.12 | 76.2 | 76.5 | 75.9 | 76.1 | |
| O-LoRABackbone=Llama-2-13B-chat2025.12 | 75.3 | 75.5 | 75.5 | 74.8 | |
| IncLoRABackbone=Llama-2-13B-chat2025.12 | 75.1 | 74.2 | 76.1 | 75.1 | |
| CorDABackbone=Llama-2-13B-chat2025.12 | 74.9 | 75.9 | 75.8 | 72.9 | |
| MagMaxBackbone=Llama-2-13B-chat2025.12 | 74.4 | 73.7 | 73.4 | 76 | |
| SeqLoRABackbone=Llama-2-13B-chat2025.12 | 74.3 | 74.1 | 74.2 | 74.5 | |
| LoRM-BABackbone=Llama-2-13B-chat2025.12 | 72.4 | 74.9 | 71.9 | 70.5 | |
| LoRM-ABBackbone=Llama-2-13B-chat2025.12 | 72.2 | 74.3 | 70.1 | 72.3 | |
| KnOTS(zero init)Backbone=Llama-2-13B-chat2025.12 | 66.1 | 66.8 | 65.5 | 66 | |
| LoRA-LEGOBackbone=Llama-2-13B-chat2025.12 | 63.9 | 64.3 | 63.3 | 64 | |
| OPCMBackbone=Llama-2-13B-chat2025.12 | 58.9 | 57.6 | 60.2 | 58.8 |