Heuristic Ensemble of Filters for Reliable Feature Selection

Ghadah Aldehim, Beatriz de la Iglesia, Wenjia Wang

2014

Abstract

Feature selection has become ever more important in data mining in recent years due to the rapid increase in the dimensionality of data. Filters are preferable in practical applications as they are much faster than wrapper based approaches, but their reliability and consistency vary considerably on different data and yet no rule exists to indicate which one should be used for a particular given dataset. In this paper, we propose a heuristic ensemble approach that combines multiple filters with heuristic rules to improve the overall performance. It consists of two types of filters: subset filters and ranking filters, and a heuristic consensus algorithm. The experimental results demonstrate that our ensemble algorithm is more reliable and effective than individual filters as the features selected by the ensemble consistently achieve better accuracy for typical classifiers on various datasets.

Paper Citation

in Harvard Style

Aldehim G., de la Iglesia B. and Wang W. (2014). Heuristic Ensemble of Filters for Reliable Feature Selection . In Proceedings of the 3rd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-018-5, pages 175-182. DOI: 10.5220/0004812401750182

in Bibtex Style

@conference{icpram14,
author={Ghadah Aldehim and Beatriz de la Iglesia and Wenjia Wang},
title={Heuristic Ensemble of Filters for Reliable Feature Selection},
booktitle={Proceedings of the 3rd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2014},
pages={175-182},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004812401750182},
isbn={978-989-758-018-5},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Heuristic Ensemble of Filters for Reliable Feature Selection
SN - 978-989-758-018-5
AU - Aldehim G.
AU - de la Iglesia B.
AU - Wang W.
PY - 2014
SP - 175
EP - 182
DO - 10.5220/0004812401750182