Continual Learning on Long Sequence (test)
82.02APSAPT-LoRA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SAPT-LoRABackbone=T5-Large2024.01 | 82.02 | 1.5 | 1.86 | -1.25 | |
| SAPT-LoRAModel=LLaMA-2-7B2024.01 | 81.75 | 2.81 | 1.09 | -2.53 | |
| SAPT-PromptBackbone=T5-Large2024.01 | 79.14 | 1.68 | 3.29 | -1.48 | |
| SAPT-PromptModel=LLaMA-2-7B2024.01 | 77.62 | 3.29 | 0.33 | -2.98 | |
| EPIBackbone=T5-Large2024.01 | 75.15 | 1.61 | -0.77 | -1.42 | |
| EPIModel=LLaMA-2-7B2024.01 | 72.27 | 5.04 | -3.12 | -0.5 | |
| ReplayModel=LLaMA-2-7B2024.01 | 71.43 | 13.64 | 0.97 | -12.73 | |
| ReplayBackbone=T5-Large2024.01 | 71.28 | 13.05 | 1.28 | -12.18 | |
| LFPT5Model=LLaMA-2-7B2024.01 | 70.31 | 5.63 | 0.51 | -4.32 | |
| O-LORABackbone=T5-Large2024.01 | 69.24 | 7 | -8.15 | -4.05 | |
| LFPT5Backbone=T5-Large2024.01 | 67.01 | 13.89 | 2.48 | -12.8 | |
| L2PBackbone=T5-Large2024.01 | 57.98 | 22.49 | 1.36 | -16.63 | |
| O-LoRAModel=LLaMA-2-7B2024.01 | 54.95 | 22.36 | -8.38 | -19.86 | |
| SeqLORABackbone=T5-Large2024.01 | 9.72 | 78.61 | 0.81 | -73.37 | |
| ProgPromptBackbone=T5-Large2024.01 | 7.98 | 71.55 | -2.63 | -66.71 |