Text Classification on Restaurant, AI, ACL, AGNews Continual Learning Sequence (test)
53.9Restaurant MF1CPT
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CPTCategory=CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 53.9 | 75.13 | 30.42 | 30.89 | 37.56 | 38.53 | 63.77 | 65.79 | 46.41 | 52.59 | 0 | 0 | |
| RoBERTa-ONECategory=Non-CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 53.63 | 76.73 | 29.86 | 30.11 | 33.05 | 35.72 | 62.57 | 65.13 | 44.78 | 51.92 | — | — | |
| DEMIXCategory=Non-CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 53.14 | 75.28 | 27.68 | 27.29 | 37.63 | 38.57 | 63.18 | 65.13 | 45.41 | 51.57 | — | — | |
| Adapter-ONECategory=Non-CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 52.19 | 74.2 | 30.8 | 31.59 | 36.59 | 36.99 | 61.66 | 63.94 | 45.31 | 51.68 | — | — | |
| BCLCategory=CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 51.7 | 74.34 | 29.66 | 30.96 | 32.85 | 34.82 | 63.6 | 65.47 | 44.45 | 51.4 | 1.47 | 0.82 | |
| RoBERTaCategory=Non-CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 50.61 | 74.77 | 27.88 | 28.44 | 32.19 | 34.59 | 64.19 | 65.95 | 43.72 | 50.94 | — | — | |
| HATCategory=CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 50.45 | 71.78 | 28.33 | 29.41 | 34.93 | 37.15 | 62.97 | 65.05 | 44.17 | 50.85 | 2.43 | 2.04 | |
| EWCCategory=CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 48.32 | 71.59 | 30.96 | 31.01 | 35.96 | 38.05 | 62.29 | 64.95 | 44.38 | 51.4 | 1.4 | 0.8 | |
| DER++Category=CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 48.09 | 71.79 | 30.71 | 30.54 | 34.25 | 35.77 | 64.24 | 66.11 | 44.32 | 51.05 | 1.79 | 1.62 | |
| Adapter-NCLCategory=CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 47.42 | 70.23 | 29.56 | 29.9 | 35.92 | 37.58 | 61.73 | 64.45 | 43.65 | 50.54 | 2.21 | 1.69 | |
| AdapterCategory=Non-CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 45.4 | 67.28 | 23.69 | 24.56 | 24.99 | 27.55 | 64.53 | 66.5 | 39.65 | 46.48 | — | — | |
| RoBERTa-NCLCategory=CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 42.59 | 67.56 | 31.57 | 31.62 | 33.07 | 34.54 | 60.18 | 63.5 | 41.85 | 49.3 | 3.27 | 2.82 | |
| KDCategory=CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 39.75 | 67.11 | 29.63 | 29.33 | 38.3 | 42.09 | 62.85 | 65.39 | 42.63 | 50.98 | 4.92 | 3.07 | |
| Prompt-ONECategory=Non-CL, Domain Training Order=Restaurant -> AI -> ACL -> AGNews2022.10 | 28.93 | 59.79 | 21.06 | 22.1 | 28.02 | 29.22 | 60.7 | 62.58 | 34.68 | 43.42 | — | — |