Continual Learning on Long Sequence Benchmark (LS)
73.6Order 4JUMPLORA + ELLA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| JUMPLORA + ELLA2026.04 | 73.6 | 68.76 | 75.81 | 72.72 | — | — | |
| ELLA2026.04 | 72.64 | 67.91 | 74.15 | 71.57 | — | — | |
| ELLA2026.06 | 72.64 | 67.91 | 74.15 | — | — | — | |
| TailLoRStrategy=head2026.06 | 71.05 | 69.04 | 72.89 | — | — | — | |
| SVFT2026.06 | 70.17 | 66.75 | 73.78 | — | — | — | |
| TailLoRStrategy=tail2026.06 | 70 | 67.97 | 72.57 | — | — | — | |
| TailLoRStrategy=uniform2026.06 | 69.07 | 65.96 | 73.96 | — | — | — | |
| JUMPLORA + IncLoRA2026.04 | 65.35 | 61.84 | 64.06 | 63.75 | — | — | |
| PiSSA2026.06 | 61.84 | 62.74 | 60.57 | — | — | — | |
| MiLoRA2026.06 | 59.73 | 57.12 | 57.27 | — | — | — | |
| IncLoRA2026.04 | 56.83 | 56.4 | 54.32 | 55.89 | — | — | |
| IncLoRA2026.06 | 56.83 | 56.4 | 54.32 | — | — | — | |
| EWC2026.04 | 44.9 | 44 | 45.4 | 44.8 | — | — | |
| EWC2026.06 | 44.9 | 44 | 45.4 | — | — | — | |
| ELLA2026.04 | — | — | — | — | -4.8 | -5.5 | |
| IncLoRA2026.04 | — | — | — | — | -22.1 | -21.2 | |
| JUMPLORA + ELLA2026.04 | — | — | — | — | -4.5 | -4.4 | |
| JUMPLORA + IncLoRA2026.04 | — | — | — | — | -15.5 | -13.3 |