Convergence Rate Analysis of TD(0) on Linear Function Approximation with Markovian Observations
1Convergence RateBhandari et al.
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Bhandari et al.Inputs=ω, ϕ∞, Without Projection=✗, Bound independent of ω=✗2025.06 | 1 | — | — | — | |
| Srikant and YingInputs=ω, α, ϕ∞, ∥θ∗∥2, Without Projection=✓, Bound independent of ω=✗2025.06 | 1 | — | — | — | |
| Patil et al.Inputs=α, ϕ∞, Without Projection=✓, Bound independent of ω=✗2025.06 | 1 | — | — | — | |
| Samsonov et al.Inputs=α, ϕ∞, Without Projection=✓, Bound independent of ω=✗2025.06 | 1 | — | — | — | |
| MitraInputs=ω, α, ϕ∞, Without Projection=✓, Bound independent of ω=✗2025.06 | 1 | — | — | — | |
| Li et al.Inputs=ω, ϕ∞, Without Projection=✓, Bound independent of ω=✗2025.06 | 1 | — | — | — | |
| Bhandari et al.Inputs=ϕ∞, Without Projection=✗, Bound independent of ω=✓2025.06 | 1 | — | — | — | |
| Liu and OlshevskyInputs=ϕ∞, Without Projection=✗, Bound independent of ω=✓2025.06 | 1 | — | — | — | |
| Sun et al.Inputs=ϕ∞, Without Projection=✗, Bound independent of ω=✗2025.06 | 1 | — | — | — | |
| Unprojected TD(0)Theorem=4.2, Inputs=ϕ∞, Without Projection=✓, Bound independent of ω=✓2025.06 | 1 | — | — | — |