Continual Learning on SelfRC, TweetQA, and SST sequence SQuAD format (test)
82.8Average EMMultitasked
Evaluation Results
| Method | Links | |
|---|---|---|
| MultitaskedEvaluation Protocol=Upper Bound, Task Order=SelfRC -> TweetQA -> SST2025.12 | 82.8 | |
| PPSEBMSampling Ratio=0.2, Generative Replay=True, Task Order=SelfRC -> TweetQA -> SST2025.12 | 80.9 | |
| LSEBMCLSampling Ratio=0.2, Generative Replay=True, Task Order=SelfRC -> TweetQA -> SST2025.12 | 80.2 | |
| PPSEBMSampling Ratio=0.05, Generative Replay=True, Task Order=SelfRC -> TweetQA -> SST2025.12 | 79.8 | |
| LSEBMCLSampling Ratio=0.05, Generative Replay=True, Task Order=SelfRC -> TweetQA -> SST2025.12 | 78.9 | |
| RVAE-LAMOLSampling Ratio=0.2, Generative Replay=True, Task Order=SelfRC -> TweetQA -> SST2025.12 | 77.2 | |
| LAMOLSampling Ratio=0.2, Generative Replay=True, Task Order=SelfRC -> TweetQA -> SST2025.12 | 76.3 | |
| RVAE-LAMOLSampling Ratio=0.05, Generative Replay=True, Task Order=SelfRC -> TweetQA -> SST2025.12 | 76.1 | |
| LAMOLSampling Ratio=0.05, Generative Replay=True, Task Order=SelfRC -> TweetQA -> SST2025.12 | 76 | |
| PPSEBMSampling Ratio=0, Generative Replay=True, Task Order=SelfRC -> TweetQA -> SST2025.12 | 57.6 | |
| LSEBMCLSampling Ratio=0, Generative Replay=True, Task Order=SelfRC -> TweetQA -> SST2025.12 | 55.4 | |
| GEMTask Order=SelfRC -> TweetQA -> SST2025.12 | 50 | |
| Fine-tunedTask Order=SelfRC -> TweetQA -> SST2025.12 | 49.8 | |
| EWCTask Order=SelfRC -> TweetQA -> SST2025.12 | 49 | |
| LAMOLSampling Ratio=0, Generative Replay=True, Task Order=SelfRC -> TweetQA -> SST2025.12 | 45.2 | |
| MASTask Order=SelfRC -> TweetQA -> SST2025.12 | 38.9 |