Sciweavers

TCS
2010

Active learning in heteroscedastic noise

13 years 2 months ago
Active learning in heteroscedastic noise
We consider the problem of actively learning the mean values of distributions associated with a finite number of options. The decision maker can select which option to generate the next observation from, the goal being to produce estimates with equally good precision for all the options. If sample means are used to estimate the unknown values then the optimal solution, assuming that the distributions are known up to a shift, is to sample from each distribution proportional to its variance. No information other than the distributions’ variances is needed to calculate the optimal solution. In this paper we propose an incremental algorithm that asymptotically achieves the same loss as an optimal rule. We prove that the excess loss suffered by this algorithm, apart from logarithmic factors, scales as n−3/2 , which we conjecture to be the optimal rate. The performance of the algorithm is illustrated on a simple problem. Key words: active learning, heteroscedastic noise, regression, s...
András Antos, Varun Grover, Csaba Szepesv&a
Added 30 Jan 2011
Updated 30 Jan 2011
Type Journal
Year 2010
Where TCS
Authors András Antos, Varun Grover, Csaba Szepesvári
Comments (0)