Sciweavers

Share
DAWAK
2010
Springer

Using Transitivity to Increase the Accuracy of Sample-Based Pearson Correlation Coefficients

8 years 11 months ago
Using Transitivity to Increase the Accuracy of Sample-Based Pearson Correlation Coefficients
Abstract. Pearson product-moment correlation coefficients are a wellpracticed quantification of linear dependence seen across many fields. When calculating a sample-based correlation coefficient, the accuracy of the estimation is dependent on the quality and quantity of the sample. Like all statistical models, these correlation coefficients can suffer from overfitting, which results in the representation of random error instead of an underlying trend. In this paper, we discuss how Pearson product-moment correlation coefficients can utilize information outside of the two items for which the correlation is being computed. By introducing a transitive relationship with one or more additional items that meet specified criterion, our Transitive Pearson product-moment correlation coefficient can significantly reduce the error, up to over 50%, of sparse, sample-based estimations. Finally, we demonstrate that if the data is too dense or too sparse, transitivity is detrimental in reducing the co...
Taylor Phillips, Chris GauthierDickey, Ramki Thuri
Added 08 Nov 2010
Updated 08 Nov 2010
Type Conference
Year 2010
Where DAWAK
Authors Taylor Phillips, Chris GauthierDickey, Ramki Thurimella
Comments (0)
books