State-Action Value Estimation Coverage on RiverSwim
0.952Q-Value Estimate (s=1, a=0)Model-based bootstrap with percentile CI
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Model-based bootstrap with percentile CIn (number of episodes)=1000, Episode length (T)=502026.05 | 0.952 | 0.954 | 0.964 | |
| Model-based bootstrap with percentile CIn (number of episodes)=500, Episode length (T)=502026.05 | 0.95 | 0.961 | 0.892 | |
| Plug-in (CLT) CIn (number of episodes)=1000, Episode length (T)=502026.05 | 0.949 | 0.955 | 0.937 | |
| Model-based bootstrap with pivot CIn (number of episodes)=100, Episode length (T)=502026.05 | 0.948 | 0.965 | 0.635 | |
| Plug-in (CLT) CIn (number of episodes)=500, Episode length (T)=502026.05 | 0.948 | 0.957 | 0.866 | |
| Model-based bootstrap with pivot CIn (number of episodes)=1000, Episode length (T)=502026.05 | 0.947 | 0.961 | 0.924 | |
| Model-based bootstrap with pivot CIn (number of episodes)=500, Episode length (T)=502026.05 | 0.944 | 0.98 | 0.903 | |
| Model-based bootstrap with percentile CIn (number of episodes)=100, Episode length (T)=502026.05 | 0.937 | 0.958 | 0.333 | |
| Episodic bootstrap with percentile CIn (number of episodes)=1000, Episode length (T)=502026.05 | 0.931 | 0.933 | 0.94 | |
| Plug-in (CLT) CIn (number of episodes)=100, Episode length (T)=502026.05 | 0.929 | 0.926 | 0.371 | |
| Episodic bootstrap with pivot CIn (number of episodes)=1000, Episode length (T)=502026.05 | 0.921 | 0.938 | 0.894 | |
| Episodic bootstrap with percentile CIn (number of episodes)=500, Episode length (T)=502026.05 | 0.91 | 0.921 | 0.842 | |
| Episodic bootstrap with pivot CIn (number of episodes)=500, Episode length (T)=502026.05 | 0.906 | 0.933 | 0.854 | |
| Model-based bootstrap with percentile CIn (number of episodes)=50, Episode length (T)=502026.05 | 0.896 | 0.886 | 0.182 | |
| Model-based bootstrap with pivot CIn (number of episodes)=50, Episode length (T)=502026.05 | 0.873 | 0.806 | 0.373 | |
| Plug-in (CLT) CIn (number of episodes)=50, Episode length (T)=502026.05 | 0.849 | 0.79 | 0.206 | |
| Episodic bootstrap with pivot CIn (number of episodes)=100, Episode length (T)=502026.05 | 0.546 | 0.575 | 0.535 | |
| Episodic bootstrap with percentile CIn (number of episodes)=100, Episode length (T)=502026.05 | 0.515 | 0.539 | 0.227 | |
| Episodic bootstrap with pivot CIn (number of episodes)=50, Episode length (T)=502026.05 | 0 | 0 | 0 | |
| Episodic bootstrap with percentile CIn (number of episodes)=50, Episode length (T)=502026.05 | 0 | 0 | 0 |