Continual Learning on TRACE sequence
55.4GP ScoreVanilla LoRA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Vanilla LoRARank=1282026.05 | 55.4 | 56.34 | |
| Vanilla LoRA (ref.)rank=642026.05 | 54.59 | 60.39 | |
| LoRAMrank=642026.05 | 2.33 | 3.14 | |
| Slicerank=64, c=0.502026.05 | 2.24 | 2.72 | |
| Slicerank=64, c=1.002026.05 | 1.76 | 2.39 | |
| Slicerank=64, c=0.752026.05 | 1.53 | 4.66 | |
| LoRA-GArank=642026.05 | 1.48 | 4.96 | |
| SLICERank=128, c=0.502026.05 | -1.44 | -6.92 | |
| SLICERank=128, c=1.002026.05 | -1.72 | -2.04 | |
| LoRA-GARank=1282026.05 | -1.77 | -1.87 | |
| SLICERank=128, c=0.752026.05 | -2.03 | -3.02 | |
| LoRAMRank=1282026.05 | -2.37 | 0.02 |