ResearchBenchmarksRecommendation on Taobao Double 11 Shopping Carnival online A/B (test)Follow12.3CTRCCN-8.084-2.7922.57.792Nov 18, 2024Evaluation ResultsMethodMethodLinksCTRClicks/UserCVROrders/UserCCNComparison=Relative to...Comparison=Relative to production baseline (SIM)2024.1112.37.40.912.7DIANComparison=Relative to...Comparison=Relative to production baseline (SIM)2024.11-5.6-6-0.9-1.5DIHNComparison=Relative to...Comparison=Relative to production baseline (SIM)2024.11-7.3-9.3-1.5-3.1