Window-averaged bilevel local regret minimization