Online
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Online (test)
13.75WER
6
Online Anti-signal length T = 100
11.3Mean Regret
4
Online Flat length T = 100
7.9Mean Regret
4
Online Stratified length T = 100
9.3Mean Regret
4
Online Item production (A/B test)
14TVT Lift
2
Online 80+ investment advisors (production)
9Advisor Manual Retry Rate
2
Online Base Demonstration
40.23Online VI Avg Accuracy
1