News Recommendation Production System
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
News Recommendation Production System Online A/B Test (Day 5)
3.651Delta CTR
2
News Recommendation Production System Online A/B Test (Day 4)
1.5Delta CTR (Relative Lift)
2
News Recommendation Production System Online A/B Test (Day 3)
1.7ΔCTR
2
News Recommendation Production System Online A/B Test (Day 2)
0.6Delta CTR
2
News Recommendation Production System Online A/B Test (Day 1)
1.247ΔCTR
2
News Recommendation Production System Online A/B Test (Average)
1.6ΔCTR
1