Online A/B
Benchmarks
TaskDatasetSOTA resultTrendResults
Online A/B (live production)
3Emerging Creator Exposure Change (%)
5
Online A/B (test)
4.9AUC
2
Online A/B (test)
2.39CTR Lift (%)
1
Online A/B Re-Ranking (test)
21Engagement Rate 1
1
Online A/B Item Scenario (test)
3.64IPV
1
Online A/B (test)
45.04Pass-Through Rate
1