75 search results - page 3 / 15 » Approximate inference by Markov chains on union spaces |
ICML
2010
IEEE
13 years 7 months ago
2010
IEEE
We consider approximate policy evaluation for finite state and action Markov decision processes (MDP) in the off-policy learning context and with the simulation-based least square...
ICML
2008
IEEE
14 years 6 months ago
2008
IEEE
Hidden Markov models assume that observations in time series data stem from some hidden process that can be compactly represented as a Markov chain. We generalize this model by as...
CDC
2009
IEEE
13 years 10 months ago
2009
IEEE
— This paper addresses model reduction for a Markov chain on a large state space. A simulation-based framework is introduced to perform state aggregation of the Markov chain base...
ICML
2009
IEEE
14 years 6 months ago
2009
IEEE
The inhomogeneous Poisson process is a point process that has varying intensity across its domain (usually time or space). For nonparametric Bayesian modeling, the Gaussian proces...
IPSN
2004
Springer
13 years 11 months ago
2004
Springer
We present a methodology for a sensor network to answer queries with limited and stochastic information using probabilistic techniques. This capability is useful in that it allows...