Sciweavers

Share
WSC
2008

On step sizes, stochastic shortest paths, and survival probabilities in Reinforcement Learning

9 years 12 months ago
On step sizes, stochastic shortest paths, and survival probabilities in Reinforcement Learning
Reinforcement Learning (RL) is a simulation-based technique useful in solving Markov decision processes if their transition probabilities are not easily obtainable or if the problems have a very large number of states. We present an empirical study of (i) the effect of step-sizes (learning rules) in the convergence of RL algorithms, (ii) stochastic shortest paths in solving average reward problems via RL, and (iii) the notion of survival probabilities (downside risk) in RL. We also study the impact of step sizes when function approximation is combined with RL. Our experiments yield some interesting insights that will be useful in practice when RL algorithms are implemented within simulators.
Abhijit Gosavi
Added 02 Oct 2010
Updated 02 Oct 2010
Type Conference
Year 2008
Where WSC
Authors Abhijit Gosavi
Comments (0)
books