Accuracy Evaluation on Standard CL Benchmark (Order Specific)
0.811Avg Final AccSPAT-LoRA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SPAT-LoRABackbone=Llama-2-7B-chat2025.12 | 0.811 | 0.829 | 0.818 | 0.787 | |
| Multi-TaskBackbone=Llama-2-7B-chat2025.12 | 0.809 | — | — | — | |
| PS-LoRABackbone=meta-llama/Llama-2-7b-chat2025.11 | 0.808 | 0.809 | 0.812 | 0.804 | |
| SLAOBackbone=Llama-2-7B-chat2025.12 | 0.804 | 0.801 | 0.808 | 0.804 | |
| MagMaxBackbone=Llama-2-7B-chat2025.12 | 0.803 | 0.801 | 0.806 | 0.803 | |
| MTLBackbone=T52025.11 | 0.8 | 0.8 | 0.8 | 0.8 | |
| MTLBackbone=T5-Large2026.05 | 0.8 | 0.8 | 0.8 | 0.8 | |
| InfLoRABackbone=Llama-2-7B-chat2025.12 | 0.796 | 0.784 | 0.804 | 0.799 | |
| PS-LoRABackbone=google-t5/t5-large2025.11 | 0.796 | 0.8 | 0.791 | 0.796 | |
| CorDABackbone=Llama-2-7B-chat2025.12 | 0.792 | 0.784 | 0.793 | 0.8 | |
| Muon-OGDBackbone=T5-Large2026.05 | 0.789 | 0.789 | 0.794 | 0.783 | |
| JUMPLORA + ELLA2026.04 | 0.7885 | 0.7884 | 0.7905 | 0.7867 | |
| ELLA2026.04 | 0.7823 | 0.7809 | 0.7837 | 0.7823 | |
| MoCLBackbone=meta-llama/Llama-2-7b-chat2025.11 | 0.782 | 0.784 | 0.777 | 0.784 | |
| Slow Surprise ReplayBackbone=T5, Architecture=Dual Learner2025.11 | 0.781 | 0.788 | 0.785 | 0.769 | |
| AM-LoRABackbone=google-t5/t5-large2025.11 | 0.78 | 0.781 | 0.798 | 0.762 | |
| MIGUBackbone=meta-llama/Llama-2-7b-chat2025.11 | 0.779 | 0.777 | 0.771 | 0.789 | |
| Slow Reservoir ReplayBackbone=T5, Architecture=Dual Learner2025.11 | 0.778 | 0.78 | 0.78 | 0.773 | |
| MoRABackbone=T52025.11 | 0.776 | 0.774 | 0.775 | 0.779 | |
| Surprise ReplayBackbone=T52025.11 | 0.772 | 0.77 | 0.781 | 0.764 | |
| O-LoRABackbone=Llama-2-7B-chat2025.12 | 0.772 | 0.761 | 0.763 | 0.792 | |
| IncLoRABackbone=Llama-2-7B-chat2025.12 | 0.77 | 0.753 | 0.773 | 0.783 | |
| LoRM-BABackbone=Llama-2-7B-chat2025.12 | 0.77 | 0.76 | 0.768 | 0.783 | |
| Reservoir ReplayBackbone=T52025.11 | 0.769 | 0.768 | 0.777 | 0.765 | |
| LB-CLBackbone=T52025.11 | 0.767 | 0.769 | 0.765 | 0.768 | |
| MIGUBackbone=google-t5/t5-large2025.11 | 0.764 | 0.772 | 0.767 | 0.754 | |
| EWC-LoRABackbone=T5-large2026.02 | 0.7639 | 0.7801 | 0.7685 | 0.743 | |
| ProgPromptBackbone=T52025.11 | 0.761 | 0.761 | 0.76 | 0.763 | |
| SeqLoRABackbone=Llama-2-7B-chat2025.12 | 0.76 | 0.733 | 0.762 | 0.784 | |
| LoRM-ABBackbone=Llama-2-7B-chat2025.12 | 0.76 | 0.775 | 0.747 | 0.759 | |
| O-LoRABackbone=meta-llama/Llama-2-7b-chat2025.11 | 0.76 | 0.768 | 0.757 | 0.757 | |
| SD-LoRABackbone=meta-llama/Llama-2-7b-chat2025.11 | 0.76 | 0.766 | 0.745 | 0.768 | |
| MoCLBackbone=google-t5/t5-large2025.11 | 0.759 | 0.756 | 0.754 | 0.767 | |
| OSFTBackbone=T5-Large2026.05 | 0.759 | 0.753 | 0.74 | 0.784 | |
| O-LoRABackbone=T5-Large2026.05 | 0.758 | 0.754 | 0.757 | 0.763 | |
| O-LoRABackbone=T52025.11 | 0.754 | 0.749 | 0.753 | 0.759 | |
| IncLoRABackbone=meta-llama/Llama-2-7b-chat2025.11 | 0.751 | 0.759 | 0.726 | 0.768 | |
| ProgPromptBackbone=T5-Large2026.05 | 0.751 | 0.752 | 0.75 | 0.751 | |
| O-LoRABackbone=T5-large2026.02 | 0.7501 | 0.7569 | 0.7492 | 0.744 | |
| SeqLoRABackbone=meta-llama/Llama-2-7b-chat2025.11 | 0.748 | 0.734 | 0.756 | 0.755 | |
| O-LoRABackbone=google-t5/t5-large2025.11 | 0.746 | 0.749 | 0.734 | 0.756 | |
| LFPT5Backbone=T5-Large2026.05 | 0.727 | 0.676 | 0.726 | 0.779 | |
| JUMPLORA + IncLoRA2026.04 | 0.716 | 0.7076 | 0.6926 | 0.7478 | |
| PerTaskFTBackbone=T52025.11 | 0.7 | 0.7 | 0.7 | 0.7 | |
| PerTaskFTBackbone=T5-Large2026.05 | 0.7 | 0.7 | 0.7 | 0.7 | |
| LoRA-LEGOBackbone=Llama-2-7B-chat2025.12 | 0.684 | 0.683 | 0.66 | 0.709 | |
| KnOTSBackbone=Llama-2-7B-chat2025.12 | 0.682 | 0.679 | 0.659 | 0.708 | |
| IncLoRABackbone=google-t5/t5-large2025.11 | 0.678 | 0.686 | 0.597 | 0.75 | |
| IncLoRABackbone=T5-Large2026.05 | 0.664 | 0.66 | 0.649 | 0.683 | |
| EWC-LoRABackbone=LLaMA-3.2-1B-Instruct2026.02 | 0.6308 | 0.6117 | 0.6047 | 0.6761 | |
| IncLoRA2026.04 | 0.626 | 0.5925 | 0.5869 | 0.6986 | |
| SD-LoRABackbone=google-t5/t5-large2025.11 | 0.615 | 0.677 | 0.559 | 0.609 | |
| L2PBackbone=google-t5/t5-large2025.11 | 0.607 | 0.603 | 0.617 | 0.611 | |
| L2PBackbone=T5-Large2026.05 | 0.607 | 0.603 | 0.617 | 0.611 | |
| TreeLoRABackbone=LLaMA-3.2-1B-Instruct2026.02 | 0.603 | 0.5854 | 0.5696 | 0.6542 | |
| OPCMBackbone=Llama-2-7B-chat2025.12 | 0.602 | 0.619 | 0.62 | 0.567 | |
| O-LoRABackbone=LLaMA-3.2-1B-Instruct2026.02 | 0.6001 | 0.5696 | 0.5574 | 0.6732 | |
| ReplayBackbone=T5-Large2026.05 | 0.578 | 0.552 | 0.569 | 0.613 | |
| LwFBackbone=google-t5/t5-large2025.11 | 0.523 | 0.544 | 0.531 | 0.496 | |
| LwFBackbone=T5-Large2026.05 | 0.523 | 0.544 | 0.531 | 0.496 | |
| EWCBackbone=google-t5/t5-large2025.11 | 0.503 | 0.487 | 0.477 | 0.545 | |
| EWCBackbone=T5-Large2026.05 | 0.503 | 0.487 | 0.477 | 0.545 | |
| EWCBackbone=T52025.11 | 0.479 | 0.463 | 0.453 | 0.521 | |
| EWC2026.04 | 0.479 | 0.463 | 0.453 | 0.521 | |
| SeqLoRABackbone=T5-Large2026.05 | 0.437 | 0.446 | 0.327 | 0.537 | |
| SLERPBackbone=T5-Large2026.05 | 0.431 | 0.405 | 0.43 | 0.458 | |
| SeqLoRABackbone=T52025.11 | 0.393 | 0.395 | 0.319 | 0.466 | |
| TIESBackbone=T5-Large2026.05 | 0.371 | 0.35 | 0.385 | 0.378 | |
| SeqFTBackbone=T52025.11 | 0.285 | 0.189 | 0.249 | 0.417 | |
| SeqFTBackbone=T5-Large2026.05 | 0.285 | 0.189 | 0.249 | 0.417 | |
| SeqLoRABackbone=google-t5/t5-large2025.11 | 0.283 | 0.257 | 0.24 | 0.352 |