Sciweavers

335 search results - page 5 / 67
» The Compositional Construction of Markov Processes
Sort
View
ICIP
2003
IEEE
16 years 1 months ago
Road network extraction in remote sensing by a Markov object process
In this paper, we rely on the theory of marked point processes to perform an unsupervised road network extraction from optical and radar images. A road network is modeled by a Mar...
Caroline Lacoste, Xavier Descombes, Josiane Zerubi...
TIT
2002
82views more  TIT 2002»
14 years 11 months ago
Order estimation for a special class of hidden Markov sources and binary renewal processes
We consider the estimation of the order, i.e., the number of hidden states, of a special class of discrete-time finite-alphabet hidden Markov sources. This class can be characteriz...
Sanjeev Khudanpur, Prakash Narayan
107
Voted
ICML
2006
IEEE
16 years 14 days ago
Fast direct policy evaluation using multiscale analysis of Markov diffusion processes
Policy evaluation is a critical step in the approximate solution of large Markov decision processes (MDPs), typically requiring O(|S|3 ) to directly solve the Bellman system of |S...
Mauro Maggioni, Sridhar Mahadevan
85
Voted
CALCO
2009
Springer
150views Mathematics» more  CALCO 2009»
15 years 6 months ago
Approximating Labelled Markov Processes Again!
Abstract. Labelled Markov processes are continuous-state fully probabilistic labelled transition systems. They can be seen as co-algebras of a suitable monad on the category of mea...
Philippe Chaput, Vincent Danos, Prakash Panangaden...
117
Voted
IWQOS
2011
Springer
14 years 2 months ago
An MDP-based admission control for a QoS-aware service-oriented system
In this paper, we address the problem of providing a service broker, which offers to prospective users a composite service with a range of different Quality of Service (QoS) class...
Marco Abundo, Valeria Cardellini, Francesco Lo Pre...