Continual Learning on SuperNI
56.95APSAPT-LoRA
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SAPT-LoRABackbone=LLaMA-2-13B2024.01 | 56.95 | 1.39 | 0.81 | -0.56 | — | |
| SAPT-PromptBackbone=LLaMA-2-13B2024.01 | 52.31 | 1.57 | 1.49 | -1.41 | — | |
| MoRAMReplay=true, Backbone=T5-Large2025.06 | 51.79 | — | 0.73 | — | — | |
| SAPTReplay=true, Backbone=T5-Large2025.06 | 51.54 | — | 0.91 | — | — | |
| ReplayBackbone=LLaMA-2-13B2024.01 | 43.99 | 11.64 | 0.72 | -9.75 | — | |
| LFPT5Backbone=LLaMA-2-13B2024.01 | 41.26 | 14.67 | -0.52 | -12.31 | — | |
| MoRAMReplay=false, Backbone=T5-Large2025.06 | 39.62 | — | 5.74 | — | — | |
| ReplayReplay=true, Backbone=T5-Large2025.06 | 35.37 | — | 16.92 | — | — | |
| O-LoRABackbone=LLaMA-2-13B2024.01 | 31.18 | 24.26 | -4.05 | -22.64 | — | |
| O-LoRAReplay=false, Backbone=T5-Large2025.06 | 26.37 | — | 19.15 | — | — | |
| C-LoRAReplay=false, Backbone=T5-Large2025.06 | 22.69 | — | 24.25 | — | — | |
| L2PReplay=false, Backbone=T5-Large2025.06 | 15.18 | — | 3.65 | — | — | |
| IncLoRAReplay=false, Backbone=T5-Large2025.06 | 12.33 | — | 41.93 | — | — | |
| MTL (Upper Bound)Backbone=T5-large2025.02 | — | — | — | — | 50.7 | |
| O-LoRABackbone=T5-large2025.02 | — | — | — | -24.6 | 25.9 | |
| Recurrent-KIFBackbone=T5-large2025.02 | — | — | — | -8.4 | 43.3 | |
| ReplayBackbone=T5-large2025.02 | — | — | — | -15.8 | 35.4 | |
| TaSLBackbone=T5-large2025.02 | — | — | — | -12.7 | 41.3 | |
| VR-MCLBackbone=T5-large2025.02 | — | — | — | -10.9 | 40.5 |