Sciweavers

Share
JMLR
2011

Minimum Description Length Penalization for Group and Multi-Task Sparse Learning

8 years 4 months ago
Minimum Description Length Penalization for Group and Multi-Task Sparse Learning
We propose a framework MIC (Multiple Inclusion Criterion) for learning sparse models based on the information theoretic Minimum Description Length (MDL) principle. MIC provides an elegant way of incorporating arbitrary sparsity patterns in the feature space by using two-part MDL coding schemes. We present MIC based models for the problems of grouped feature selection (MICGROUP) and multi-task feature selection (MIC-MULTI). MIC-GROUP assumes that the features are divided into groups and induces two level sparsity, selecting a subset of the feature groups, and also selecting features within each selected group. MIC-MULTI applies when there are multiple related tasks that share the same set of potentially predictive features. It also induces two level sparsity, selecting a subset of the features, and then selecting which of the tasks each feature should be added to. Lastly, we propose a model, TRANSFEAT, that can be used to transfer knowledge from a set of previously learned tasks to a n...
Paramveer S. Dhillon, Dean P. Foster, Lyle H. Unga
Added 14 May 2011
Updated 14 May 2011
Type Journal
Year 2011
Where JMLR
Authors Paramveer S. Dhillon, Dean P. Foster, Lyle H. Ungar
Comments (0)
books