Continual Learning on Long Sequence (Order 1)
82.87APFPP + SABER-P
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FPP + SABER-PBackbone=LLaMA-2-7B2026.05 | 82.87 | 1.56 | |
| SPA + SABER-LBackbone=LLaMA-2-7B2026.05 | 82.65 | 1.87 | |
| FPP + SABER-LBackbone=LLaMA-2-7B2026.05 | 82.23 | 1.12 | |
| SPA + SABER-PBackbone=LLaMA-2-7B2026.05 | 81.47 | 1.39 | |
| SPA + SABER-PBackbone=T5-Large2026.05 | 80.84 | 0.93 | |
| SPA + SABER-LBackbone=T5-Large2026.05 | 80.67 | 0.87 | |
| FPP + SABER-PBackbone=T5-Large2026.05 | 80.46 | 1.76 | |
| FPP + SABER-LBackbone=T5-Large2026.05 | 80.12 | 2.13 | |
| SHLPTBackbone=LLaMA-2-7B2026.05 | 79.4 | -0.27 | |
| ProgPromptBackbone=LLaMA-2-7B2026.05 | 78.98 | -0.18 | |
| SAPTBackbone=LLaMA-2-7B2026.05 | 78.43 | -0.86 | |
| SAPTBackbone=T5-Large2026.05 | 78.14 | -0.45 | |
| SHLPTBackbone=T5-Large2026.05 | 77.4 | -0.29 | |
| CODA PromptBackbone=T5-Large2026.05 | 76.21 | -0.54 | |
| ProgPromptBackbone=T5-Large2026.05 | 75.43 | -0.12 | |
| LFPTBackbone=LLaMA-2-7B2026.05 | 72.65 | -0.94 | |
| LFPT5Backbone=T5-Large2026.05 | 69.35 | -0.76 | |
| L2PBackbone=T5-Large2026.05 | 60.43 | -1.43 | |
| ReplayBackbone=LLaMA-2-7B2026.05 | 60.32 | -19.54 | |
| ReplayBackbone=T5-Large2026.05 | 56.2 | -12.18 |