Offline replay comparison on smoke-scale artifacts Abstention benchmark (offline replay)
67.5Success RateOracle
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Oracle2026.04 | 67.5 | 0 | 50 | 25 | -5.9 | |
| RSCB-MC2026.04 | 62.5 | 0 | 35 | 25 | -31.74 | |
| Risk-TS2026.04 | 60 | 0 | 37.5 | 22.5 | -33.7 | |
| UCB12026.04 | 55 | 2.5 | 50 | 17.5 | -35.865 | |
| Epsilon-greedy2026.04 | 53.8 | 8.7 | 30 | 21.3 | -49.818 | |
| Thompson2026.04 | 53.7 | 2.5 | 38.8 | 20 | -52.315 | |
| Lexical2026.04 | 50 | 17.5 | 0 | 25 | -70.8 | |
| Static2026.04 | 50 | 17.5 | 0 | 25 | -70.8 | |
| LinUCB2026.04 | 37.5 | 10 | 50 | 15 | -76.775 | |
| Static+Abs2026.04 | 35 | 2.5 | 75 | 10 | -33.35 |