Continual Learning on SuperNI Benchmark
50.9Average ScoreSPAT-LoRA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SPAT-LoRABackbone=Llama-2-7B-chat2025.12 | 50.9 | 53.2 | 48.5 | |
| Multi-TaskBackbone=Llama-2-7B-chat2025.12 | 45.2 | — | — | |
| SLAOBackbone=Llama-2-7B-chat2025.12 | 37.2 | 38.7 | 35.7 | |
| KnOTSBackbone=Llama-2-7B-chat2025.12 | 32.4 | 34.6 | 30.1 | |
| LoRA-LEGOBackbone=Llama-2-7B-chat2025.12 | 29.8 | 32.8 | 26.7 | |
| O-LoRABackbone=Llama-2-7B-chat2025.12 | 25.9 | 23.3 | 28.4 | |
| LoRM-ABBackbone=Llama-2-7B-chat2025.12 | 24.7 | 25.6 | 23.7 | |
| IncLoRABackbone=Llama-2-7B-chat2025.12 | 23.8 | 22 | 25.6 | |
| SeqLoRABackbone=Llama-2-7B-chat2025.12 | 22.6 | 18.4 | 26.8 | |
| LoRM-BABackbone=Llama-2-7B-chat2025.12 | 22.2 | 25.6 | 18.7 | |
| InfLoRABackbone=Llama-2-7B-chat2025.12 | 19.3 | 16.5 | 22.1 | |
| CorDABackbone=Llama-2-7B-chat2025.12 | 18.5 | 20.9 | 16 | |
| OPCMBackbone=Llama-2-7B-chat2025.12 | 12 | 11.6 | 12.3 | |
| MagMaxBackbone=Llama-2-7B-chat2025.12 | 11.2 | 15.3 | 7 |