Sciweavers

774 search results - page 41 / 155
» Markov incremental constructions
Sort
View
ISMB
1993
14 years 11 months ago
Using Dirichlet Mixture Priors to Derive Hidden Markov Models for Protein Families
A Bayesian method for estimating the amino acid distributions in the states of a hidden Markov model (HMM) for a protein familyor the columns of a multiple alignment of that famil...
Michael Brown, Richard Hughey, Anders Krogh, I. Sa...
AUTOMATICA
2005
117views more  AUTOMATICA 2005»
14 years 10 months ago
Dwell-time controllers for stochastic systems with switching Markov chain
We study the problem of feedback stabilization of a family of nonlinear stochastic systems with switching mechanism modeled by a Markov chain. We introduce a novel notion of stabi...
Stefano Battilotti, A. De Santis
TIT
2002
82views more  TIT 2002»
14 years 9 months ago
Order estimation for a special class of hidden Markov sources and binary renewal processes
We consider the estimation of the order, i.e., the number of hidden states, of a special class of discrete-time finite-alphabet hidden Markov sources. This class can be characteriz...
Sanjeev Khudanpur, Prakash Narayan
TCBB
2011
14 years 5 months ago
Semi-Markov Models for Brownian Dynamics Permeation in Biological Ion Channels
—Constructing accurate computational models that explain how ions permeate through a biological ion channel is an important problem in biophysics and drug design. Brownian dynami...
Vikram Krishnamurthy, Kai Yiu Luk
ICML
2002
IEEE
15 years 11 months ago
Discovering Hierarchy in Reinforcement Learning with HEXQ
An open problem in reinforcement learning is discovering hierarchical structure. HEXQ, an algorithm which automatically attempts to decompose and solve a model-free factored MDP h...
Bernhard Hengst