Various Fusion Schemes to Recognize Simulated and Spontaneous Emotions

Sonia Gharsalli, Hélène Laurent, Bruno Emile, Xavier Desquesnes

2015

Abstract

This paper investigates the performance of combining geometric features and appearance features with various fusion strategies in a facial emotion recognition application. Geometric features are extracted by a distance-based method; appearance features are extracted by a set of Gabor filters. Various fusion methods are proposed from two principal classes namely early fusion and late fusion. The former combines features in the feature space, the latter fuses both feature types in the decision space by a statistical rule or a classification method. Distance-based method, Gabor method and hybrid methods are evaluated on simulated (CK+) and spontaneous (FEEDTUM) databases. The comparison between methods shows that late fusion methods have better recognition rates than the early fusion method. Moreover, late fusion methods based on statistical rules perform better than the other hybrid methods for simulated emotion recognition. However in the recognition of spontaneous emotions, the statistical-based methods improve the recognition of positive emotions, while the classification-based method slightly enhances sadness and disgust recognition. A comparison with hybrid methods from the literature is also made.

Paper Citation

in Harvard Style

Gharsalli S., Laurent H., Emile B. and Desquesnes X. (2015). Various Fusion Schemes to Recognize Simulated and Spontaneous Emotions . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-090-1, pages 424-431. DOI: 10.5220/0005312804240431

in Bibtex Style

@conference{visapp15,
author={Sonia Gharsalli and Hélène Laurent and Bruno Emile and Xavier Desquesnes},
title={Various Fusion Schemes to Recognize Simulated and Spontaneous Emotions},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={424-431},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005312804240431},
isbn={978-989-758-090-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015)
TI - Various Fusion Schemes to Recognize Simulated and Spontaneous Emotions
SN - 978-989-758-090-1
AU - Gharsalli S.
AU - Laurent H.
AU - Emile B.
AU - Desquesnes X.
PY - 2015
SP - 424
EP - 431
DO - 10.5220/0005312804240431