Order estimation for a special class of hidden Markov sources and binary renewal processes

We consider the estimation of the order, i.e., the number of hidden states, of a special class of discrete-time finite-alphabet hidden Markov sources. This class can be characterized in terms of equivalent renewal processes. No a priori bound is assumed on the maximum permissible order. An order estimator based on renewal types is constructed, and is shown to be strongly consistent by computing the precise asymptotics of the probability of estimation error. The probability of underestimation of the true order decays exponentially in the number of observations while the probability of overestimation goes to zero sufficiently fast. It is further shown that this estimator has the best possible error exponent in a large class of estimators. Our results are also valid for the general class of binary independent-renewal processes with finite mean renewal times.

• Type: Journal
• Year: 2002
• Where: TIT
• Authors: Sanjeev Khudanpur, Prakash Narayan
• Keywords: Estimators, Maximum Permissible Order, Order Estimator, TIT 2002