Sciweavers

Share
COLT
2006
Springer

Logarithmic Regret Algorithms for Online Convex Optimization

11 years 9 months ago
Logarithmic Regret Algorithms for Online Convex Optimization
In an online convex optimization problem a decision-maker makes a sequence of decisions, i.e., chooses a sequence of points in Euclidean space, from a fixed feasible set. After each point is chosen, it encounters a sequence of (possibly unrelated) convex cost functions. Zinkevich [Zin03] introduced this framework, which models many natural repeated decision-making problems and generalizes many existing problems such as Prediction from Expert Advice and Cover's Universal Portfolios. Zinkevich showed that a simple online gradient descent algorithm achieves additive regret O( T), for an arbitrary sequence of T convex cost functions (of bounded gradients), with respect to the best single decision in hindsight. In this paper, we give algorithms that achieve regret O(log(T)) for an arbitrary sequence of strictly convex functions (with bounded first and second derivatives). This mirrors what has been done for the special cases of prediction from expert advice by Kivinen and Warmuth [KW...
Elad Hazan, Adam Kalai, Satyen Kale, Amit Agarwal
Added 20 Aug 2010
Updated 20 Aug 2010
Type Conference
Year 2006
Where COLT
Authors Elad Hazan, Adam Kalai, Satyen Kale, Amit Agarwal
Comments (0)
books