Sciweavers

PAKDD
2015
ACM

Learning of Performance Measures from Crowd-Sourced Data with Application to Ranking of Investments

7 years 11 months ago
Learning of Performance Measures from Crowd-Sourced Data with Application to Ranking of Investments
Abstract. Interestingness measures stand as proxy for “real human interest,” but their effectiveness is rarely studied empirically due to the difficulty of obtaining ground-truth data. We propose a method based on learning-to-rank algorithms that enables pairwise rankings collected from domain community members to be used to learn a domain-specific measure. We apply this method to study the interestingness measures in finance, specifically, investment performance evaluation measures. More than 100 such measures have been proposed with no way of knowing which most closely matches the preferences of domain users. We use crowd-sourcing to collect gold-standard truth from traders and quantitative analysts in the form of pairwise rankings of equity graphs. With these rankings, we evaluate the accuracy with which each measure predicts the user-preferred equity graph. We then learn a new investment performance measure which has higher test accuracy than the currently proposed measures...
Greg Harris, Anand V. Panangadan, Viktor K. Prasan
Added 16 Apr 2016
Updated 16 Apr 2016
Type Journal
Year 2015
Where PAKDD
Authors Greg Harris, Anand V. Panangadan, Viktor K. Prasanna
Comments (0)