Sciweavers

Share
ALT
2008
Springer

Active Learning in Multi-armed Bandits

9 years 7 months ago
Active Learning in Multi-armed Bandits
In this paper we consider the problem of actively learning the mean values of distributions associated with a finite number of options (arms). The algorithms can select which option to generate the next sample from in order to produce estimates with equally good precision for all the distributions. When an algorithm uses sample means to estimate the unknown values then the optimal solution, assuming full knowledge of the distributions, is to sample each option proportional to its variance. In this paper we propose an incremental algorithm that asymptotically achieves the same loss as an optimal rule. We prove that the excess loss suffered by this algorithm, apart from logarithmic factors, scales as n−3/2 , which we conjecture to be the optimal rate. The performance of the algorithm is illustrated in a simple problem.
András Antos, Varun Grover, Csaba Szepesv&a
Added 14 Mar 2010
Updated 14 Mar 2010
Type Conference
Year 2008
Where ALT
Authors András Antos, Varun Grover, Csaba Szepesvári
Comments (0)
books