On the Rademacher Complexity of Weighted Automata

4 years 10 months ago
On the Rademacher Complexity of Weighted Automata
Weighted automata (WFAs) provide a general framework for the representation of functions mapping strings to real numbers. They include as special instances deterministic finite automata (DFAs), hidden Markov models (HMMs), and predictive states representations (PSRs). In recent years, there has been a renewed interest in weighted automata in machine learning due to the development of efficient and provably correct spectral algorithms for learning weighted automata. Despite the effectiveness reported for spectral techniques in real-world problems, almost all existing statistical guarantees for spectral learning of weighted automata rely on a strong realizability assumption. In this paper, we initiate a systematic study of the learning guarantees for broad classes of weighted automata in an agnostic setting. Our results include bounds on the Rademacher complexity of three general classes of weighted automata, each described in terms of different natural quantities. Interestingly, thes...
Borja Balle, Mehryar Mohri
Added 15 Apr 2016
Updated 15 Apr 2016
Type Journal
Year 2015
Where ALT
Authors Borja Balle, Mehryar Mohri
Comments (0)