Off-Policy Evaluation on RiverSwim mostly-left policy, T=50
55.7Qπ(1, 0) CoverageModel-based bootstrap with pivot CI
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Model-based bootstrap with pivot CIn=100, Nominal coverage=50%2026.05 | 55.7 | 57.3 | 44 | 55.7 | 55.9 | 56 | 50 | 35.9 | 44.5 | |
| Model-based bootstrap with pivot CIn=50, Nominal coverage=50%2026.05 | 53.3 | 45.9 | 23.4 | 53.3 | 53 | 44.9 | 29.4 | 14.5 | 22.7 | |
| Model-based bootstrap with pivot CIn=500, Nominal coverage=50%2026.05 | 53.1 | 48.3 | 53.4 | 53.1 | 51.9 | 51.4 | 51.9 | 51.1 | 52 | |
| Model-based bootstrap with percentile CIn=500, Nominal coverage=50%2026.05 | 52.3 | — | 49.8 | 52.3 | 51.4 | 51.1 | 52.1 | 51.8 | 50.1 | |
| Plug-in (CLT) CIn=500, Nominal coverage=50%2026.05 | 52.3 | 48.5 | 45.3 | 52.3 | 52 | 50.4 | 51.4 | 46.1 | 43.2 | |
| Model-based bootstrap with percentile CIn=100, Nominal coverage=50%2026.05 | 51.1 | 44.4 | 31.2 | 51.1 | 50.6 | 47.5 | 40.4 | 32.5 | 32.4 | |
| Model-based bootstrap with pivot CIn=1000, Nominal coverage=50%2026.05 | 50.6 | 51.2 | 51.9 | 50.6 | 49.9 | 50.5 | 51.3 | 51.7 | 52.1 | |
| Plug-in (CLT) CIn=100, Nominal coverage=50%2026.05 | 50.5 | 46.6 | 15.4 | 50.5 | 51 | 48 | 42.6 | 32.3 | 14.2 | |
| Episodic bootstrap with percentile CIn=500, Nominal coverage=50%2026.05 | 50 | 47.2 | 47.5 | 50 | 49.5 | 48.2 | 49 | 47.4 | 46.2 | |
| Plug-in (CLT) CIn=1000, Nominal coverage=50%2026.05 | 49.7 | 50.2 | 49.4 | 49.7 | 49.6 | 50.3 | 50.2 | 49.5 | 48.8 | |
| Episodic bootstrap with pivot CIn=500, Nominal coverage=50%2026.05 | 49.5 | 46.6 | 51.4 | 49.5 | 49.2 | 48.7 | 49.3 | 49.8 | 47.3 | |
| Model-based bootstrap with percentile CIn=1000, Nominal coverage=50%2026.05 | 49.3 | 49 | 50.1 | 49.3 | 50.1 | 49.4 | 50.7 | 49.9 | 51.2 | |
| Episodic bootstrap with pivot CIn=1000, Nominal coverage=50%2026.05 | 48.4 | 46.6 | 49.8 | 48.4 | 47.7 | 47.7 | 47.8 | 49.8 | 49.7 | |
| Episodic bootstrap with percentile CIn=1000, Nominal coverage=50%2026.05 | 47.9 | 46.2 | 48 | 47.9 | 47.5 | 46.9 | 47.5 | 48 | 48 | |
| Plug-in (CLT) CIn=50, Nominal coverage=50%2026.05 | 40.7 | 28.4 | 7.3 | 40.7 | 39.1 | 33.1 | 23 | 14.3 | 7.7 | |
| Model-based bootstrap with percentile CIn=50, Nominal coverage=50%2026.05 | 38.9 | 29.6 | 22.9 | 38.9 | 36.4 | 29.7 | 8.7 | 3.6 | 23.8 | |
| Episodic bootstrap with pivot CIn=100, Nominal coverage=50%2026.05 | 31.8 | 37.5 | 24.9 | 31.8 | 31.7 | 35.1 | 35.4 | 31.3 | 25.5 | |
| Episodic bootstrap with percentile CIn=100, Nominal coverage=50%2026.05 | 29.3 | 30.3 | 20.6 | 29.3 | 31 | 29.6 | 32.2 | 30.8 | 20.3 | |
| Episodic bootstrap with pivot CIn=50, Nominal coverage=50%2026.05 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | |
| Episodic bootstrap with percentile CIn=50, Nominal coverage=50%2026.05 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |