Representing Systems with Hidden State

We discuss the problem of finding a good state representation in stochastic systems with observations. We develop a duality theory that generalizes existing work in predictive state representations as well as automata theory. We discuss how this theoretical framework can be used to build learning algorithms, approximate planning algorithms as well as to deal with continuous observations.

• Type: Conference
• Year: 2006
• Where: AAAI
• Authors: Christopher Hundt, Prakash Panangaden, Joelle Pineau, Doina Precup
• Keywords: AAAI 2006, Approximate Planning Algorithms, Intelligent Agents, Predictive State Representations, State Representations