Continual Learning on G2 sequence
52.05GP MetricVanilla LoRA (ref.)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Vanilla LoRA (ref.)rank=642026.05 | 52.05 | 59.41 | |
| Vanilla LoRARank=1282026.05 | 51.97 | 58.7 | |
| LoRA-GArank=642026.05 | 5.18 | 20.28 | |
| Slicerank=64, c=0.752026.05 | 4.78 | 22.37 | |
| Slicerank=64, c=1.002026.05 | 4.66 | 13.18 | |
| Slicerank=64, c=0.502026.05 | 4.38 | 21.08 | |
| LoRAMrank=642026.05 | 0.78 | 5.34 | |
| LoRAMRank=1282026.05 | -0.85 | -5.12 | |
| LoRA-GARank=1282026.05 | -1.34 | -2.58 | |
| SLICERank=128, c=0.502026.05 | -1.43 | -3.48 | |
| SLICERank=128, c=0.752026.05 | -1.45 | -1.9 | |
| SLICERank=128, c=1.002026.05 | -1.59 | -4.34 |