ON THE SUITABILITY OF NUMERICAL PERFORMANCE MEASURES FOR CLASS IMBALANCE PROBLEMS

Vicente García, J. Salvador Sánchez, Ramón A. Mollineda

2012

Abstract

The class imbalance problem has been reported as an important challenge in various fields such as Pattern Recognition, Data Mining and Machine Learning. A less explored research area is related to how to evaluate classifiers on imbalanced data sets. This work analyzes the behaviour of performance measures widely used on imbalanced problems, as well as other metrics recently proposed in the literature. We perform two theoretical analysis based on Pearson correlation and operations for a 2×2 confusion matrix with the aim to show the strengths and weaknesses of those performance metrics in the presence of skewed distributions.

Paper Citation

in Harvard Style

García V., Salvador Sánchez J. and A. Mollineda R. (2012). ON THE SUITABILITY OF NUMERICAL PERFORMANCE MEASURES FOR CLASS IMBALANCE PROBLEMS . In Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-8425-98-0, pages 310-313. DOI: 10.5220/0003783303100313

in Bibtex Style

@conference{icpram12,
author={Vicente García and J. Salvador Sánchez and Ramón A. Mollineda},
title={ON THE SUITABILITY OF NUMERICAL PERFORMANCE MEASURES FOR CLASS IMBALANCE PROBLEMS},
booktitle={Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2012},
pages={310-313},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003783303100313},
isbn={978-989-8425-98-0},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 1st International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - ON THE SUITABILITY OF NUMERICAL PERFORMANCE MEASURES FOR CLASS IMBALANCE PROBLEMS
SN - 978-989-8425-98-0
AU - García V.
AU - Salvador Sánchez J.
AU - A. Mollineda R.
PY - 2012
SP - 310
EP - 313
DO - 10.5220/0003783303100313