Evolving Classifier Ensembles using Dynamic Multi-objective Swarm Intelligence

Jean-François Connolly, Eric Granger, Robert Sabourin

2013

Abstract

Classification systems are often designed using a limited amount of data from complex and changing pattern recognition environments. In applications where new reference samples become available over time, adaptive multi-classifier systems (AMCSs) are desirable for updating class models. In this paper, an incremental learning strategy based on an aggregated dynamical niching particle swarm optimization (ADNPSO) algorithm is proposed to efficiently evolve heterogeneous classifier ensembles in response to new reference data. This strategy is applied to an AMCS where all parameters of a pool of fuzzy ARTMAP (FAM) neural network classifiers, each one corresponding to a PSO particle, are co-optimized such that both error rate and network size are minimized. To sustain a high level of accuracy while minimizing the computational complexity, the AMCS integrates information from multiple diverse classifiers, where learning is guided by the ADNPSO algorithm that optimizes networks according both these objectives. Moreover, FAM networks are evolved to maintain (1) genotype diversity of solutions around local optima in the optimization search space, and (2) phenotype diversity in the objective space. Using local Pareto optimality, networks are then stored in an archive to create a pool of base classifiers among which cost-effective ensembles are selected on the basis of accuracy, and both genotype and phenotype diversity. Performance of the ADNPSO strategy is compared against AMCSs where learning of FAM networks is guided through mono- and multi-objective optimization, and assessed under different incremental learning scenarios, where new data is extracted from real-world video streams for face recognition. Simulation results indicate that the proposed strategy provides a level of accuracy that is comparable to that of using mono-objective optimization, yet requires only a fraction of its resources.

Paper Citation

in Harvard Style

Connolly J., Granger E. and Sabourin R. (2013). Evolving Classifier Ensembles using Dynamic Multi-objective Swarm Intelligence . In Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-8565-41-9, pages 206-215. DOI: 10.5220/0004269302060215

in Bibtex Style

@conference{icpram13,
author={Jean-François Connolly and Eric Granger and Robert Sabourin},
title={Evolving Classifier Ensembles using Dynamic Multi-objective Swarm Intelligence},
booktitle={Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2013},
pages={206-215},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004269302060215},
isbn={978-989-8565-41-9},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 2nd International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Evolving Classifier Ensembles using Dynamic Multi-objective Swarm Intelligence
SN - 978-989-8565-41-9
AU - Connolly J.
AU - Granger E.
AU - Sabourin R.
PY - 2013
SP - 206
EP - 215
DO - 10.5220/0004269302060215