Query Rewriting on Large-scale e-commerce shopping platform (US market) (test)

0.116MRRTransformer+Aggregation+Graph

Evaluation results

Method
Transformer+Aggregation+Graph2022.09	0.116	—	0.201	28.2
BART+Aggregation+Graph2022.09	0.105	0.075	0.176	32.9
Transformer+Aggregation2022.09	0.102	0.07	0.173	27.2
BART+Aggregation2022.09	0.097	0.064	0.171	31.9
Transformer2022.09	0.085	0.056	0.159	25.3
MeshBART2022.09	0.083	0.058	0.143	31.7
MeshTransformer2022.09	0.083	0.056	0.157	25.9
BART2022.09	0.082	0.055	0.148	30.9
HRED2022.09	0.081	0.057	0.142	25.7
BART+Aggregation+Graph2022.09	0.069	0.046	0.118	32.9
LQRW2022.09	0.068	0.049	0.126	29.4
Transformer+Aggregation+Graph2022.09	0.066	0.046	0.12	28.2
BART+Aggregation2022.09	0.063	0.039	0.109	31.9
Transformer+Aggregation2022.09	0.052	0.029	0.108	27.2
MeshBART2022.09	0.05	0.038	0.087	31.7
HRED2022.09	0.047	0.032	0.084	25.7
BART2022.09	0.046	0.031	0.082	30.9
Transformer2022.09	0.043	0.026	0.092	25.3
MeshTransformer2022.09	0.04	0.027	0.084	25.9
LQRW2022.09	0.035	0.025	0.064	29.4