Continual Learning on G2
36.99APLoRA-GA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| LoRA-GArank=642026.05 | 36.99 | 32.81 | 4.19 | |
| LoRAMrank=642026.05 | 21.58 | 5.69 | 15.88 | |
| Vanilla LoRArank=642026.05 | 18.83 | 9.04 | 9.79 | |
| Slicerank=64, c=0.75, baseline=Vanilla LoRA2026.05 | 18.62 | 14.25 | 4.36 | |
| Slicerank=64, c=1.00, baseline=Vanilla LoRA2026.05 | 18.48 | 22.55 | -4.07 | |
| Slicerank=64, c=0.50, baseline=Vanilla LoRA2026.05 | 16.87 | 22.71 | -5.84 | |
| Slicerank=64, c=0.75, baseline=LoRAM2026.05 | 15.88 | 17.61 | -1.73 | |
| Slicerank=64, c=1.00, baseline=LoRAM2026.05 | 15.74 | 25.91 | -10.16 | |
| Slicerank=64, c=0.50, baseline=LoRAM2026.05 | 14.13 | 26.06 | -11.93 | |
| LoRAMRank=1282026.05 | 4.73 | 15.45 | 10.72 | |
| LoRA-GARank=1282026.05 | 4.56 | 31.89 | 27.33 | |
| Vanilla LoRARank=1282026.05 | 3.12 | 18.64 | 15.52 | |
| SliceRank=128, Base Initializer=LoRAM, c=0.502026.05 | 1.13 | 18.61 | 19.73 | |
| SliceRank=128, Base Initializer=LoRA-GA, c=0.502026.05 | 0.96 | 2.16 | 3.12 | |
| SliceRank=128, Base Initializer=LoRAM, c=0.752026.05 | 0.94 | 17.06 | 18 | |
| SliceRank=128, Base Initializer=LoRAM, c=1.002026.05 | 0.83 | 15.79 | 16.62 | |
| SliceRank=128, Base Initializer=Vanilla LoRA, c=1.002026.05 | 0.78 | 12.61 | 11.83 | |
| SliceRank=128, Base Initializer=LoRA-GA, c=0.752026.05 | 0.78 | 0.61 | 1.39 | |
| SliceRank=128, Base Initializer=Vanilla LoRA, c=0.752026.05 | 0.67 | 13.87 | 13.2 | |
| SliceRank=128, Base Initializer=LoRA-GA, c=1.002026.05 | 0.66 | 0.65 | 0.01 | |
| SliceRank=128, Base Initializer=Vanilla LoRA, c=0.502026.05 | 0.48 | 15.42 | 14.94 | |
| Slicerank=64, c=0.75, baseline=LoRA-GA2026.05 | 0.46 | -9.51 | 9.97 | |
| Slicerank=64, c=1.00, baseline=LoRA-GA2026.05 | 0.33 | -1.21 | 1.54 | |
| Slicerank=64, c=0.50, baseline=LoRA-GA2026.05 | -1.29 | -1.06 | -0.23 |