Sciweavers

ALT
2006
Springer

Asymptotic Learnability of Reinforcement Problems with Arbitrary Dependence

14 years 19 days ago
Asymptotic Learnability of Reinforcement Problems with Arbitrary Dependence
We address the problem of reinforcement learning in which observations may exhibit an arbitrary form of stochastic dependence on past observations and actions. The task for an agent is to attain the best possible asymptotic reward where the true generating environment is unknown but belongs to a known countable family of environments. We find some sufficient conditions on the class of environments under which an agent exists which attains the best asymptotic reward for any environment in the class. We analyze how tight these conditions are and how they relate to different probabilistic assumptions known in reinforcement learning and related fields, such as Markov Decision Processes and mixing conditions. Keywords Reinforcement learning, asymptotic average value, self-optimizing policies, (non) Markov decision processes. ∗ This work was supported by the Swiss NSF grant 200020-107616. 1
Daniil Ryabko, Marcus Hutter
Added 14 Mar 2010
Updated 14 Mar 2010
Type Conference
Year 2006
Where ALT
Authors Daniil Ryabko, Marcus Hutter
Comments (0)