Sciweavers

2990 search results - page 153 / 598
» Hidden Markov processes
Sort
View
CDC
2010
IEEE
145views Control Systems» more  CDC 2010»
15 years 1 months ago
Construction of Lyapunov functions for piecewise-deterministic Markov processes
The purpose of this contribution is twofold: 1) to present for the first time a Lyapunov function that proves exponential ergodicity of a process studied by the authors in [1], whe...
Alexandre R. Mesquita, João Pedro Hespanha
ICML
2006
IEEE
16 years 7 months ago
Fast direct policy evaluation using multiscale analysis of Markov diffusion processes
Policy evaluation is a critical step in the approximate solution of large Markov decision processes (MDPs), typically requiring O(|S|3 ) to directly solve the Bellman system of |S...
Mauro Maggioni, Sridhar Mahadevan
165
Voted
ICML
2001
IEEE
16 years 7 months ago
Symmetry in Markov Decision Processes and its Implications for Single Agent and Multiagent Learning
This paper examines the notion of symmetry in Markov decision processes (MDPs). We define symmetry for an MDP and show how it can be exploited for more effective learning in singl...
Martin Zinkevich, Tucker R. Balch
154
Voted
CALCO
2009
Springer
150views Mathematics» more  CALCO 2009»
16 years 21 days ago
Approximating Labelled Markov Processes Again!
Abstract. Labelled Markov processes are continuous-state fully probabilistic labelled transition systems. They can be seen as co-algebras of a suitable monad on the category of mea...
Philippe Chaput, Vincent Danos, Prakash Panangaden...
CDC
2008
IEEE
16 years 18 days ago
The vanishing approach for the average continuous control of piecewise deterministic Markov processes
Abstract— This paper deals with the long run average continuous control problem of piecewise deterministic Markov processes (PDMP‘s) taking values in a general Borel space and ...
Oswaldo Luiz V. Costa, Francois Dufour