Multi-task Recommendation on AliExpress (test) benchmark leaderboard · SOTA2 Research

Multi-task Recommendation on AliExpress (test)

0.7402CTR ESForkMerge

Evaluation Results

Method	Links
ForkMerge2023.01		0.7402	0.7427	0.7416	0.7069	0.8928	0.8786	0.8753	0.8752	0.8067	1.3
DWA2023.01		0.7317	0.7284	0.7297	0.7061	0.8663	0.8695	0.8696	0.8484	0.7937	-0.28
OL_AUX2023.01		0.7311	0.7211	0.7239	0.705	0.8779	0.8651	0.861	0.8727	0.7947	0.54
STL2023.01		0.7299	0.7316	0.7237	0.7077	0.8778	0.8682	0.8652	0.8659	0.7963	—
EW2023.01		0.7299	0.73	0.7248	0.7008	0.8855	0.8516	0.8606	0.8618	0.7931	-0.39
Post-train2023.01		0.7291	0.7227	0.7244	0.7086	0.8889	0.8808	0.8654	0.8613	0.7977	0.14
Auto-λ2023.01		0.7282	0.7282	0.7263	0.7114	0.8852	0.8646	0.864	0.875	0.7979	0.19
CAGrad2023.01		0.728	0.7271	0.7223	0.6996	0.8712	0.865	0.8417	0.8648	0.79	-0.77
ARML2023.01		0.7278	0.7247	0.7236	0.703	0.878	0.8671	0.8678	0.867	0.7949	0.55
UW2023.01		0.7276	0.7235	0.725	0.7048	0.8814	0.8709	0.8599	0.8793	0.7966	0
GradNorm2023.01		0.7239	0.7178	0.7101	0.7035	0.8851	0.8671	0.8465	0.8685	0.7903	-0.79
NashMTL2023.01		0.7229	0.7245	0.7272	0.6972	0.8562	0.8606	0.8667	0.8497	0.7881	-1
GCS2023.01		0.7229	0.7245	0.7272	0.6972	0.8562	0.8606	0.8667	0.8497	0.7881	-0.49
PCGrad2023.01		0.7209	0.7193	0.7199	0.6892	0.8563	0.8621	0.8479	0.8413	0.7821	-1.76
IMTL2023.01		0.7203	0.7193	0.7268	0.6852	0.8472	0.8502	0.8481	0.8282	0.7782	-2.2
MGDA2023.01		0.6985	0.6926	0.7	0.6676	0.8215	0.8145	0.7978	0.7917	0.748	-5.94