Continual Learning on Long Sequence
82.32APSAPT-LoRA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SAPT-LoRABackbone=LLaMA-2-13B2024.01 | 82.32 | 1.98 | 0.78 | -1.57 | |
| SAPT-PromptBackbone=LLaMA-2-13B2024.01 | 78.54 | 3.26 | 0.14 | -2.98 | |
| EPIBackbone=LLaMA-2-13B2024.01 | 76.66 | 4.91 | -0.09 | -1.03 | |
| ReplayBackbone=LLaMA-2-13B2024.01 | 76.63 | 7.92 | 0.02 | -14.86 | |
| LFPT5Backbone=LLaMA-2-13B2024.01 | 71.61 | 6.51 | -1.34 | -3.78 | |
| O-LoRABackbone=LLaMA-2-13B2024.01 | 61.21 | 19.03 | -10.4 | -17.54 |