Active learning for Hidden Markov Models: objective functions and algorithms

Hidden Markov Models (HMMs) model sequential data in many fields such as text/speech processing and biosignal analysis. Active learning algorithms learn faster and/or better by closing the data-gathering loop, i.e., they choose the examples most informative with respect to their learning objectives. We introduce a framework and objective functions for active learning in three fundamental HMM problems: model learning, state estimation, and path estimation. In addition, we describe a new set of algorithms for efficiently finding optimal greedy queries using these objective functions. The algorithms are fast, i.e., linear in the number of time steps to select the optimal query and we present empirical results showing that these algorithms can significantly reduce the need for labelled training data.

• Type: Conference
• Year: 2005
• Where: ICML
• Authors: Brigham Anderson, Andrew Moore
• Keywords: Active Learning Algorithms, ICML 2005, Machine Learning, Objective Functions, Optimal Greedy Queries