Continual Learning on SuperNI (test)
56.23APSAPT-LoRA
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SAPT-LoRAModel=LLaMA-2-7B2024.01 | 56.23 | 1.07 | 0.81 | -0.65 | |
| SAPT-LoRABackbone=T5-Large2024.01 | 51.54 | 0.91 | 1.88 | -0.57 | |
| SAPT-PromptModel=LLaMA-2-7B2024.01 | 47.39 | 2.12 | 0.92 | -2.02 | |
| SAPT-PromptBackbone=T5-Large2024.01 | 41.11 | 1.32 | 1.95 | -0.65 | |
| ReplayModel=LLaMA-2-7B2024.01 | 39.48 | 14.86 | 0.19 | -26.47 | |
| LFPT5Model=LLaMA-2-7B2024.01 | 38.71 | 16.81 | 0.32 | -15.42 | |
| ReplayBackbone=T5-Large2024.01 | 35.37 | 16.92 | -1.35 | -15.79 | |
| LFPT5Backbone=T5-Large2024.01 | 34.37 | 15.8 | -0.46 | -14.47 | |
| O-LORABackbone=T5-Large2024.01 | 25.89 | 26.37 | -0.14 | -24.59 | |
| O-LoRAModel=LLaMA-2-7B2024.01 | 24.26 | 27.56 | -6.09 | -25.73 | |
| L2PBackbone=T5-Large2024.01 | 12.73 | 11.87 | -19.14 | -7.95 | |
| SeqLORABackbone=T5-Large2024.01 | 6.43 | 33.39 | -13.58 | -30.94 | |
| ProgPromptBackbone=T5-Large2024.01 | 3.34 | 35.57 | -3.29 | -33.18 |