ResearchBenchmarksLanguage Model Continual Learning on Standard CL Benchmark Order 1Language Model Continual Learning on Standard CL Benchmark Order 1Follow77.24Average PerformanceO-LoRA4553.3761.7470.11May 11, 2026Evaluation resultsMethodMethodLinksAverage PerformanceLast Task PerformanceForgettingO-LoRAType=RISEType=RISE2026.0577.2488.811.43O-LoRAType=FOType=FO2026.0577.1989.042.83SeqLoRAType=RISEType=RISE2026.0574.8589.467.01O-LoRAType=ZOType=ZO2026.0562.4261.70.98SeqLoRAType=FOType=FO2026.0553.3389.9935.57SeqLoRAType=ZOType=ZO2026.0546.2462.053.67