ResearchBenchmarksCTR Prediction on Taobao display advertising system Online A/B test (2018-06-07 to 2018-07-12)Follow20.7CTR GainDIEN-0.8284.76110.3515.939Sep 11, 2018Oct 22, 2018Dec 2, 2018Jan 12, 2019Feb 22, 2019Apr 4, 2019May 15, 2019Evaluation ResultsMethodMethodLinksCTR GainPPC GaineCPM GainDIEN2018.0920.7-317.1DIN2018.098.9-26.7BSTAverage RT(ms)=20, Num...Average RT(ms)=20, Number of transformer blocks (b)=12019.057.57——DINAverage RT(ms)=16Average RT(ms)=162019.054.55——WDLAverage RT(ms)=14, Seq...Average RT(ms)=14, Sequence features=true2019.053.03——BaseModel2018.09000