Scenario
Benchmarks
TaskDatasetSOTA resultTrendResults
Scenario I
100Success Rate
6
Scenario Set 1 Short Horizon
4,996Reward
6
Scenario 3 T = 5000
63.1Win Rate (Proposed > Alternative)
6
Scenario 2
1.58Revenue per Ad
6
Scenario 4 Uniform Bids 1.0 (test)
0.516Revenue per Ad
6
Scenario 3 (test)
1.19Revenue per Ad
6
Scenario 1 (5 Ads + 1 Organic Document)
1.64Revenue per Ad
6
Scenario Static S1
98Selection Accuracy
6
Scenario 1 Dynamic
92Tracking Rate
6
Scenario 3 Four-arm setup
0.075Planning Time (Q1)
6
Scenario 2 Two-arm setup with obstacle
0.057Time Q1
6
Scenario 1 Two-arm setup
0.013Planning Time (Q1)
6
Scenario 1 (Sce1)
-0.67Mean Reward
6
scenario scarce v0.3.2
99.5Retention
5
scenario tight v0.3.2
99Retention
5
Scenario 2
197Mean Loop Time (ms)
5
Scenario 1
196Mean Loop Time (ms)
5
Scenario 6
3False Alarm Rate (FAR)
5
Scenario 5
2False Alarm Rate (FAR)
5
Scenario 4
4FAR
5
Scenario 3
1False Alarm Rate
5
Scenario 2
3False Alarm Rate (FAR)
5
Scenario 1
4False Alarm Rate (FAR)
5
Scenario 2 Android to Linux
0.91ROC-AUC
5
Scenario 2 Android to Windows
0.75ROC-AUC
5