2005 search results - page 57 / 401 » Decisive Markov Chains |
109
click to vote
TACAS
2007
Springer
15 years 7 months ago
2007
Springer
This paper studies the effect of bisimulation minimisation in model checking of monolithic discrete-time and continuous-time Markov chains as well as variants thereof with rewards...
LCN
2002
IEEE
15 years 6 months ago
2002
IEEE
Wireless channels usually face bursty errors, i.e., errors are prone to occur in clusters. These bit errors can be modeled using the Gilbert-Elliott model. When data packets are t...
ICALP
2000
Springer
15 years 5 months ago
2000
Springer
This report presents a formal approach to reducing sequences in PEPA components. Performing the described amalgamation procedure we may remove, from the underlying Markov chain, t...
ICML
2010
IEEE
15 years 2 months ago
2010
IEEE
In this paper we consider the problem of policy evaluation in reinforcement learning, i.e., learning the value function of a fixed policy, using the least-squares temporal-differe...
IJCV
2006
15 years 1 months ago
2006
In this paper, we present an algorithm for parsing natural images into middle level vision representations