Information Preserving Dimensionality Reduction

7 years 10 months ago
Information Preserving Dimensionality Reduction
Dimensionality reduction is a very common preprocessing approach in many machine learning tasks. The goal is to design data representations that on one hand reduce the dimension of the data (therefore allowing faster processing), and on the other hand aim to retain as much task-relevant information as possible. We look at generic dimensionality reduction approaches that do not rely on much task-specific prior knowledge. However, we focus on scenarios in which unlabeled samples are available and can be utilized for evaluating the usefulness of candidate data representations. We wish to provide some theoretical principles to help explain the success of certain dimensionality reduction techniques in classification prediction tasks, as well as to guide the choice of dimensionality reduction tool and parameters. Our analysis is based on formalizing the often implicit assumption that “similar instances are likely to have similar labels”. Our theoretical analysis is supported by experim...
Shrinu Kushagra, Shai Ben-David
Added 15 Apr 2016
Updated 15 Apr 2016
Type Journal
Year 2015
Where ALT
Authors Shrinu Kushagra, Shai Ben-David
Comments (0)