End-task Classification on Continual DAP Domain Suite Restaurant, ACL, AI, Phone, Camera, PubMed
0.8096Restaurant Macro F1Pool
Evaluation results
| Method | Links | ||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PoolCategory=Non-CL, Model=Pool2023.02 | 0.8096 | 0.878 | 0.7411 | 0.6969 | 0.7597 | 0.6855 | 0.8695 | 0.8496 | 0.8603 | 0.7334 | — | 0.9083 | 0.815 | 0.7725 | — | — | |
| DAP-RoBERTaCategory=Non-CL, Model=DAP-RoBERTa2023.02 | 0.8084 | 0.8768 | 0.7344 | 0.6875 | 0.7595 | 0.6897 | 0.855 | 0.8259 | 0.8439 | 0.7284 | — | 0.899 | 0.8089 | 0.764 | — | — | |
| DASCategory=CL DAP-train, Model=DAS2023.02 | 0.8034 | 0.8716 | 0.7401 | 0.6936 | 0.7746 | 0.7093 | 0.877 | 0.8599 | 0.8816 | 0.728 | — | 0.923 | 0.8191 | 0.7793 | -1.09 | -0.6 | |
| DAP-AdapterCategory=Non-CL, Model=DAP-Adapter2023.02 | 0.8019 | 0.8714 | 0.7292 | 0.6887 | 0.7138 | 0.6055 | 0.8535 | 0.8271 | 0.8362 | 0.7168 | — | 0.8923 | 0.7962 | 0.746 | — | — | |
| NCL-AdapterCategory=CL DAP-train, Model=NCL-Adapter2023.02 | 0.8013 | 0.8705 | 0.723 | 0.6739 | 0.6987 | 0.5771 | 0.8586 | 0.8332 | 0.837 | 0.7207 | — | 0.8971 | 0.7948 | 0.7405 | 0.15 | -0.02 | |
| DEMIXCategory=CL DAP-train, Model=DEMIX2023.02 | 0.7999 | 0.8712 | 0.7273 | 0.6846 | 0.7286 | 0.6335 | 0.8242 | 0.7807 | 0.8659 | 0.7173 | — | 0.9112 | 0.7966 | 0.747 | 0.74 | 0.36 | |
| CLASSICCategory=CL DAP-train, Model=CLASSIC2023.02 | 0.7989 | 0.8705 | 0.7211 | 0.673 | 0.7108 | 0.5984 | 0.8622 | 0.8402 | 0.8693 | 0.6983 | — | 0.9125 | 0.7959 | 0.7463 | 0.44 | 0.25 | |
| RoBERTaCategory=Non-CL, Model=RoBERTa2023.02 | 0.7981 | 0.87 | 0.7126 | 0.6611 | 0.7185 | 0.6098 | 0.8608 | 0.8375 | 0.8603 | 0.7238 | — | 0.8703 | 0.7927 | 0.7364 | — | — | |
| NCLCategory=CL DAP-train, Model=NCL2023.02 | 0.7952 | 0.8654 | 0.7287 | 0.6839 | 0.7571 | 0.6794 | 0.8633 | 0.841 | 0.8571 | 0.7249 | — | 0.907 | 0.8077 | 0.7636 | 1.14 | 1.05 | |
| HAT-AdapterCategory=CL DAP-train, Model=HAT-Adapter2023.02 | 0.7929 | 0.867 | 0.7287 | 0.6825 | 0.7367 | 0.6484 | 0.8237 | 0.8144 | 0.7463 | 0.8927 | — | 0.7978 | — | — | -0.23 | -0.18 | |
| DAP-PromptCategory=Non-CL, Model=DAP-Prompt2023.02 | 0.79 | 0.8645 | 0.7135 | 0.6666 | 0.7236 | 0.6147 | 0.8653 | 0.8417 | 0.8552 | 0.7309 | — | 0.9038 | 0.8003 | 0.7498 | — | — | |
| BCLCategory=CL DAP-train, Model=BCL2023.02 | 0.7897 | 0.8652 | 0.7458 | 0.7071 | 0.7455 | 0.6626 | 0.8463 | 0.817 | 0.8506 | 0.7199 | — | 0.9051 | 0.8046 | 0.7578 | -0.06 | -0.19 | |
| KDCategory=CL DAP-train, Model=KD2023.02 | 0.7805 | 0.8559 | 0.7373 | 0.6917 | 0.7509 | 0.6749 | 0.8499 | 0.8212 | 0.8191 | 0.7228 | — | 0.8869 | 0.8006 | 0.7517 | -0.07 | 0.01 | |
| HATCategory=CL DAP-train, Model=HAT2023.02 | 0.7642 | 0.8516 | 0.6879 | 0.607 | 0.6569 | 0.4737 | 0.7404 | 0.7233 | 0.668 | 0.8514 | — | 0.7565 | — | — | -0.13 | -0.29 | |
| HAT-AllCategory=CL DAP-train, Model=HAT-All2023.02 | 0.7494 | 0.8393 | 0.6394 | 0.5208 | 0.5607 | 0.3416 | 0.6554 | 0.6471 | 0.5993 | 0.8144 | — | 0.7133 | — | — | 3.23 | 1.83 | |
| EWCCategory=CL DAP-train, Model=EWC2023.02 | 0.7117 | 0.7258 | 0.6997 | 0.6504 | 0.7443 | 0.7358 | 0.8513 | 0.8232 | 0.8098 | 0.7143 | — | 0.8764 | 0.7216 | 0.6594 | 0.02 | -0.01 | |
| DER++Category=CL DAP-train, Model=DER++2023.02 | 0.6396 | 0.7354 | 0.8561 | 0.8322 | 0.7913 | 0.6814 | 0.871 | 0.8456 | 0.9147 | 0.7161 | — | 0.7551 | 0.803 | 0.7551 | 2.36 | 1.53 |