Sciweavers

ATAL
2007
Springer

On discovery and learning of models with predictive representations of state for agents with continuous actions and observations

13 years 7 months ago
On discovery and learning of models with predictive representations of state for agents with continuous actions and observations
Models of agent-environment interaction that use predictive state representations (PSRs) have mainly focused on the case of discrete observations and actions. The theory of discrete PSRs uses an elegant construct called the system dynamics matrix and derives the notion of predictive state as a sufficient statistic via the rank of the matrix. With continuous observations and actions, such a matrix and its rank no longer exist. In this paper, we show how to define an analogous construct for the continuous case, called the system dynamics distributions, and use information theoretic notions to define a sufficient statistic and thus state. Given this new construct, we use kernel density estimation to learn approximate system dynamics distributions from data, and use information-theoretic tools to derive algorithms for discovery of state and learning of model parameters. We illustrate our new modeling method on two example problems. Categories and Subject Descriptors I.2.6 [Artificial Inte...
David Wingate, Satinder P. Singh
Added 12 Aug 2010
Updated 12 Aug 2010
Type Conference
Year 2007
Where ATAL
Authors David Wingate, Satinder P. Singh
Comments (0)