Continual Learning (Backward Transfer) on ConTinTin
4.74BWT g_1InstructionSpeak
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| InstructionSpeakNegative Training=enabled, History Training=disabled, Training task size (k)=52022.03 | 4.74 | -2.78 | -0.83 | 1.35 | 3.49 | |
| LAMOLTraining task size (k)=52022.03 | 2.67 | 2.21 | 9.42 | 6.33 | 7.21 | |
| InstructionSpeakNegative Training=disabled, History Training=enabled, Training task size (k)=52022.03 | 2.21 | 3.37 | 11.44 | 10.36 | 8.94 | |
| Seq-finetuneTraining task size (k)=52022.03 | 1.57 | 0.04 | -0.19 | -6.48 | -9.46 | |
| InstructionSpeakNegative Training=enabled, History Training=enabled, Training task size (k)=52022.03 | 1.44 | 5.21 | 7.33 | 14.99 | 12.31 |