Continual Learning on Opp3 sequence
52.47GP ScoreVanilla LoRA (ref.)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Vanilla LoRA (ref.)rank=642026.05 | 52.47 | 60.09 | |
| Vanilla LoRARank=1282026.05 | 51.89 | 59.71 | |
| LoRA-GArank=642026.05 | 2.58 | 6.63 | |
| Slicerank=64, c=0.752026.05 | 2.14 | 3.95 | |
| Slicerank=64, c=1.002026.05 | 1.67 | 6.61 | |
| Slicerank=64, c=0.502026.05 | 1.51 | 7.3 | |
| LoRAMrank=642026.05 | 1.49 | 2.57 | |
| SLICERank=128, c=0.752026.05 | -0.16 | -2.36 | |
| SLICERank=128, c=0.502026.05 | -0.27 | -2.86 | |
| SLICERank=128, c=1.002026.05 | -0.58 | -2.71 | |
| LoRA-GARank=1282026.05 | -0.6 | -4.5 | |
| LoRAMRank=1282026.05 | -0.88 | -2.41 |