ResearchBenchmarksRecommendation on Production large-scale recommendation system (Online A/B Test)Recommendation on Production large-scale recommendation system (Online A/B Test)Follow0.133Standard Deviation (SD)E2E-GRec0.126350.1296750.1330.136325Nov 25, 2025Evaluation resultsMethodMethodLinksStandard Deviation (SD)Latency (P7)Skip Rate (per Play)Skip Rate (per User)Pass-Through Rate (PTR)Total OrdersGMVCTR (Page-view)E2E-GRecMetric Type=Lift (%) r...Metric Type=Lift (%) relative to production baseline2025.110.1330.0262-17.35-31.7112.47———UniRecTesting Type=Online A/...Testing Type=Online A/B Testing2026.04—————4.765.60.0537