Continual Learning on Opp3
26.32APVanilla LoRA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Vanilla LoRArank=642026.05 | 26.32 | 4.32 | 22 | |
| LoRAMrank=642026.05 | 24 | 12.95 | 11.05 | |
| LoRA-GArank=642026.05 | 21.29 | 14.52 | 6.77 | |
| LoRA-GARank=1282026.05 | 10.27 | 18 | 7.73 | |
| LoRAMRank=1282026.05 | 8.62 | 28.08 | 19.46 | |
| Vanilla LoRARank=1282026.05 | 7.64 | 3.4 | 4.24 | |
| SliceRank=128, Base Initializer=LoRA-GA, c=1.002026.05 | 5.34 | 8.62 | 13.96 | |
| SliceRank=128, Base Initializer=Vanilla LoRA, c=0.752026.05 | 4.42 | 24.1 | 19.68 | |
| SliceRank=128, Base Initializer=Vanilla LoRA, c=0.502026.05 | 4.36 | 23.69 | 19.33 | |
| Slicerank=64, c=1.00, baseline=LoRA-GA2026.05 | 4.23 | 2.04 | 2.19 | |
| SliceRank=128, Base Initializer=LoRAM, c=1.002026.05 | 3.7 | 1.46 | 2.23 | |
| SliceRank=128, Base Initializer=LoRAM, c=0.752026.05 | 3.44 | 0.57 | 4.01 | |
| SliceRank=128, Base Initializer=LoRAM, c=0.502026.05 | 3.38 | 0.98 | 4.36 | |
| SliceRank=128, Base Initializer=Vanilla LoRA, c=1.002026.05 | 2.71 | 23.22 | 25.93 | |
| Slicerank=64, c=0.75, baseline=LoRA-GA2026.05 | 2.52 | 8.04 | -5.52 | |
| SliceRank=128, Base Initializer=LoRA-GA, c=0.752026.05 | 1.79 | 9.51 | 7.72 | |
| SliceRank=128, Base Initializer=LoRA-GA, c=0.502026.05 | 1.73 | 9.1 | 7.37 | |
| Slicerank=64, c=0.50, baseline=LoRA-GA2026.05 | 1.54 | -4.52 | 6.05 | |
| Slicerank=64, c=1.00, baseline=LoRAM2026.05 | 1.53 | 3.61 | -2.09 | |
| Slicerank=64, c=0.75, baseline=LoRAM2026.05 | -0.19 | 9.61 | -9.8 | |
| Slicerank=64, c=1.00, baseline=Vanilla LoRA2026.05 | -0.8 | 12.25 | -13.04 | |
| Slicerank=64, c=0.50, baseline=LoRAM2026.05 | -1.17 | -2.95 | 1.77 | |
| Slicerank=64, c=0.75, baseline=Vanilla LoRA2026.05 | -2.51 | 18.24 | -20.75 | |
| Slicerank=64, c=0.50, baseline=Vanilla LoRA2026.05 | -3.5 | 5.69 | -9.18 |