Sciweavers

Share
CORR
2006
Springer

PAC Learning Mixtures of Axis-Aligned Gaussians with No Separation Assumption

8 years 10 months ago
PAC Learning Mixtures of Axis-Aligned Gaussians with No Separation Assumption
Abstract. We propose and analyze a new vantage point for the learning of mixtures of Gaussians: namely, the PAC-style model of learning probability distributions introduced by Kearns et al. [12]. Here the task is to construct a hypothesis mixture of Gaussians that is statistically indistinguishable from the actual mixture generating the data; specifically, the KL divergence should be at most . In this scenario, we give a poly(n/ ) time algorithm that learns the class of mixtures of any constant number of axis-aligned Gaussians in Rn . Our algorithm makes no assumptions about the separation between the means of the Gaussians, nor does it have any dependence on the minimum mixing weight. This is in contrast to learning results known in the "clustering" model, where such assumptions are unavoidable. Our algorithm relies on the method of moments, and a subalgorithm developed in [8] for a discrete mixture-learning problem.
Jon Feldman, Ryan O'Donnell, Rocco A. Servedio
Added 11 Dec 2010
Updated 11 Dec 2010
Type Journal
Year 2006
Where CORR
Authors Jon Feldman, Ryan O'Donnell, Rocco A. Servedio
Comments (0)
books