Beyond Accuracy, F-Score and ROC: A Family of Discriminant Measures for Performance Evaluation

Different evaluation measures assess different characteristics of machine learning algorithms. The empirical evaluation of algorithms and classifiers is a matter of on-going debate between researchers. Although most measures in use today focus on a classifier's ability to identify classes correctly, we suggest that, in certain cases, other properties, such as failure avoidance or class discrimination may also be useful. We suggest the application of measures which evaluate such properties. These measures

• Type: Conference
• Year: 2006
• Where: AUSAI
• Authors: Marina Sokolova, Nathalie Japkowicz, Stan Szpakowicz
• Keywords: Artificial Intelligence, AUSAI 2006, Empirical Evaluation, Machine Learning Algorithms, On-going Debate