End-task Classification on Continual DAP Domain Suite Restaurant, ACL, AI, Phone, Camera, PubMed benchmark leaderboard · SOTA2 Research

End-task Classification on Continual DAP Domain Suite Restaurant, ACL, AI, Phone, Camera, PubMed

0.8096Restaurant Macro F1Pool

Evaluation Results

Method	Links
Pool2023.02		0.8096	0.878	0.7411	0.6969	0.7597	0.6855	0.8695	0.8496	0.8603	0.7334	—	0.9083	0.815	0.7725	—	—
DAP-RoBERTa2023.02		0.8084	0.8768	0.7344	0.6875	0.7595	0.6897	0.855	0.8259	0.8439	0.7284	—	0.899	0.8089	0.764	—	—
DAS2023.02		0.8034	0.8716	0.7401	0.6936	0.7746	0.7093	0.877	0.8599	0.8816	0.728	—	0.923	0.8191	0.7793	-1.09	-0.6
DAP-Adapter2023.02		0.8019	0.8714	0.7292	0.6887	0.7138	0.6055	0.8535	0.8271	0.8362	0.7168	—	0.8923	0.7962	0.746	—	—
NCL-Adapter2023.02		0.8013	0.8705	0.723	0.6739	0.6987	0.5771	0.8586	0.8332	0.837	0.7207	—	0.8971	0.7948	0.7405	0.15	-0.02
DEMIX2023.02		0.7999	0.8712	0.7273	0.6846	0.7286	0.6335	0.8242	0.7807	0.8659	0.7173	—	0.9112	0.7966	0.747	0.74	0.36
CLASSIC2023.02		0.7989	0.8705	0.7211	0.673	0.7108	0.5984	0.8622	0.8402	0.8693	0.6983	—	0.9125	0.7959	0.7463	0.44	0.25
RoBERTa2023.02		0.7981	0.87	0.7126	0.6611	0.7185	0.6098	0.8608	0.8375	0.8603	0.7238	—	0.8703	0.7927	0.7364	—	—
NCL2023.02		0.7952	0.8654	0.7287	0.6839	0.7571	0.6794	0.8633	0.841	0.8571	0.7249	—	0.907	0.8077	0.7636	1.14	1.05
HAT-Adapter2023.02		0.7929	0.867	0.7287	0.6825	0.7367	0.6484	0.8237	0.8144	0.7463	0.8927	—	0.7978	—	—	-0.23	-0.18
DAP-Prompt2023.02		0.79	0.8645	0.7135	0.6666	0.7236	0.6147	0.8653	0.8417	0.8552	0.7309	—	0.9038	0.8003	0.7498	—	—
BCL2023.02		0.7897	0.8652	0.7458	0.7071	0.7455	0.6626	0.8463	0.817	0.8506	0.7199	—	0.9051	0.8046	0.7578	-0.06	-0.19
KD2023.02		0.7805	0.8559	0.7373	0.6917	0.7509	0.6749	0.8499	0.8212	0.8191	0.7228	—	0.8869	0.8006	0.7517	-0.07	0.01
HAT2023.02		0.7642	0.8516	0.6879	0.607	0.6569	0.4737	0.7404	0.7233	0.668	0.8514	—	0.7565	—	—	-0.13	-0.29
HAT-All2023.02		0.7494	0.8393	0.6394	0.5208	0.5607	0.3416	0.6554	0.6471	0.5993	0.8144	—	0.7133	—	—	3.23	1.83
EWC2023.02		0.7117	0.7258	0.6997	0.6504	0.7443	0.7358	0.8513	0.8232	0.8098	0.7143	—	0.8764	0.7216	0.6594	0.02	-0.01
DER++2023.02		0.6396	0.7354	0.8561	0.8322	0.7913	0.6814	0.871	0.8456	0.9147	0.7161	—	0.7551	0.803	0.7551	2.36	1.53