Continual Learning on Opp sequence 1
52.41GPVanilla LoRA (ref.)
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Vanilla LoRA (ref.)rank=642026.05 | 52.41 | 60.26 | |
| Vanilla LoRARank=1282026.05 | 51.7 | 59.35 | |
| LoRA-GArank=642026.05 | 2.34 | 8.52 | |
| Slicerank=64, c=0.502026.05 | 2.27 | 6.61 | |
| Slicerank=64, c=1.002026.05 | 2.12 | 8.65 | |
| LoRAMrank=642026.05 | 1.88 | 4.84 | |
| Slicerank=64, c=0.752026.05 | 1.64 | 5.27 | |
| LoRAMRank=1282026.05 | -0.49 | -5.24 | |
| SLICERank=128, c=0.752026.05 | -0.66 | -3.67 | |
| SLICERank=128, c=1.002026.05 | -0.79 | -4.97 | |
| LoRA-GARank=1282026.05 | -1.21 | -4.28 | |
| SLICERank=128, c=0.502026.05 | -1.26 | -4.84 |