ResearchBenchmarksLanguage Model Continual Learning on Large Number of Tasks Order 3Language Model Continual Learning on Large Number of Tasks Order 3Follow74.06Average PerformanceO-LoRA23.661636.745849.8362.9142May 11, 2026Evaluation resultsMethodMethodLinksAverage PerformanceLast Task PerformanceForgettingO-LoRAType=RISEType=RISE2026.0574.0654.553.16O-LoRAType=FOType=FO2026.0572.7254.443.8SeqLoRAType=RISEType=RISE2026.0562.6556.6617.77O-LoRAType=ZOType=ZO2026.0556.4852.193.76SeqLoRAType=FOType=FO2026.0527.6252.4350.62SeqLoRAType=ZOType=ZO2026.0525.653.6115.83