List your company

Reinforcement Learning on episodic finite-horizon linear MDPs

1Dynamic RegretDouble-Restart Q-UCB
0.841.9234.08Apr 17, 2026

Evaluation results

MethodLinks
Double-Restart Q-UCBPrior-Free=true2026.041———
RestartQ-UCBPrior-Free=false2026.043———
DARLING + UCMQPrior-Free=true2026.043———
Lower Bound2026.043———
MASTERPrior-Free=true2026.043———
DARLING + LSVI-UCB++Prior-Free=true2026.043———
Lower Bound2026.043———
LSVI-UCB-RestartPrior-Free=false2026.044———
MASTERPrior-Free=true2026.045———
OPT-WLSVIPrior-Free=false2026.045———
ADA-LSVI-UCB-RestartPrior-Free=true2026.045———
Liu et al. (2023)Policy Param.=implicit, Clipping Q-Function=yes2026.03—1—2
LMC-NPG-EXPPolicy Param.=explicit, Clipping Q-Function=yes2026.03—112
Sherman et al. (2023)Policy Param.=implicit, Clipping Q-Function=no2026.03——12