Sciweavers

Share
NIPS
1998

Outcomes of the Equivalence of Adaptive Ridge with Least Absolute Shrinkage

11 years 1 months ago
Outcomes of the Equivalence of Adaptive Ridge with Least Absolute Shrinkage
Adaptive Ridge is a special form of Ridge regression, balancing the quadratic penalization on each parameter of the model. It was shown to be equivalent to Lasso (least absolute shrinkage and selection operator), in the sense that both procedures produce the same estimate. Lasso can thus be viewed as a particular quadratic penalizer. From this observation, we derive a fixed point algorithm to compute the Lasso solution. The analogy provides also a new hyper-parameter for tuning effectively the model complexity. We finally present a series of possible extensions of lasso performing sparse regression in kernel smoothing, additive modeling and neural net training.
Yves Grandvalet, Stéphane Canu
Added 01 Nov 2010
Updated 01 Nov 2010
Type Conference
Year 1998
Where NIPS
Authors Yves Grandvalet, Stéphane Canu
Comments (0)
books