Continual Learning (Forward Transfer) on ConTinTin
2.16Gain @ Task 1InstructionSpeak
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| InstructionSpeakNegative Training=enabled, History Training=enabled, Training task size (k)=52022.03 | 2.16 | 5.06 | 2.29 | 4.07 | 4.39 | |
| InstructionSpeakNegative Training=enabled, History Training=disabled, Training task size (k)=52022.03 | 1.88 | 3.32 | 4.41 | 3.22 | 2.97 | |
| Seq-finetuneTraining task size (k)=52022.03 | 1.44 | 3.28 | -3.74 | 2.9 | -0.36 | |
| LAMOLTraining task size (k)=52022.03 | -1.34 | 1.41 | 3.31 | -5.4 | -0.03 | |
| InstructionSpeakNegative Training=disabled, History Training=enabled, Training task size (k)=52022.03 | -2.89 | 1.06 | 1.33 | 2.21 | 1.78 |