Continual Learning on Continual Learning Benchmark 15-Task
78.1Average AccuracyPerTaskFT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PerTaskFTBackbone=T5-Large2026.05 | 78.1 | 78.1 | 78.1 | 78.1 | |
| ProgPromptBackbone=T5-Large2026.05 | 77.9 | 78 | 77.7 | 77.9 | |
| MTLBackbone=T5-Large2026.05 | 76.5 | 76.5 | 76.5 | 76.5 | |
| MTLBackbone=T5-Large2025.06 | 76.5 | — | — | — | |
| Muon-OGDBackbone=T5-Large2026.05 | 72 | 72.2 | 70.3 | 73.5 | |
| OSFTBackbone=T5-Large2026.05 | 71.3 | 71.6 | 69.6 | 72.7 | |
| O-LoRABackbone=T5-Large2026.05 | 69.6 | 72.3 | 64.8 | 71.6 | |
| LFPT5Backbone=T5-Large2026.05 | 69.2 | 70.4 | 68.2 | 69.1 | |
| MoRAMBackbone=T5-Large2025.06 | 68.32 | — | — | — | |
| LB-CLBackbone=T5-Large2025.06 | 67.3 | — | — | — | |
| LFPT5Backbone=T5-Large2025.06 | 67.2 | — | — | — | |
| O-LoRABackbone=T5-Large2025.06 | 65.5 | — | — | — | |
| IncLoRABackbone=T5-Large2026.05 | 61.2 | 63.3 | 58.5 | 61.7 | |
| IncLoRABackbone=T5-Large2025.06 | 58.5 | — | — | — | |
| L2PBackbone=T5-Large2026.05 | 56.1 | 57.5 | 53.8 | 56.9 | |
| ReplayBackbone=T5-Large2025.06 | 54.6 | — | — | — | |
| ReplayBackbone=T5-Large2026.05 | 54.2 | 55 | 54.6 | 53.1 | |
| L2PBackbone=T5-Large2025.06 | 53.8 | — | — | — | |
| LwFBackbone=T5-Large2026.05 | 46.9 | 50.1 | 43.1 | 47.4 | |
| EWCBackbone=T5-Large2026.05 | 45.1 | 45.3 | 44.5 | 45.6 | |
| EWCBackbone=T5-Large2025.06 | 44.5 | — | — | — | |
| LwFBackbone=T5-Large2025.06 | 43.1 | — | — | — | |
| SeqFTBackbone=T5-Large2026.05 | 7.4 | 7.4 | 7.4 | 7.5 | |
| SeqFTBackbone=T5-Large2025.06 | 7.4 | — | — | — | |
| TIESBackbone=T5-Large2026.05 | 6.9 | 7.8 | 7.1 | 5.8 | |
| SLERPBackbone=T5-Large2026.05 | 2.2 | 2.4 | 1.5 | 2.7 | |
| SeqLoRABackbone=T5-Large2026.05 | 1.6 | 2.3 | 0.6 | 1.9 | |
| SeqLoRABackbone=T5-Large2025.06 | 0.6 | — | — | — |