54 search results - page 2 / 11 » The document as an ergodic markov chain |
WIOPT
2011
IEEE
12 years 8 months ago
2011
IEEE
—Most work on wireless network throughput ignore the temporal correlation inherent to wireless channels, due to trouble with tractability. In order to better capture the temporal...
ORL
2007
13 years 4 months ago
2007
In ergodic MDPs we consider stationary distributions of policies that coincide in all but n states, in which one of two possible actions is chosen. We give conditions and formulas...
CORR
2011
Springer
12 years 12 months ago
2011
Springer
The Shannon-McMillan-Breiman theorem asserts that the sample entropy of a stationary and ergodic stochastic process converges to the entropy rate of the same process almost surely...
MOR
2006
13 years 4 months ago
2006
: We study general state-space Markov chains that depend on a parameter, say, . Sufficient conditions are established for the stationary performance of such a Markov chain to be di...
AUTOMATICA
2010
13 years 5 months ago
2010
The work here explores new numerical methods for supporting a Bayesian approach to parameter estimation of dynamic systems. This is primarily motivated by the goal of providing ac...