Robust Facial Landmark Detection and Face Tracking in Thermal Infrared Images using Active Appearance Models

Marcin Kopaczka, Kemal Acar, Dorit Merhof

2016

Abstract

Long wave infrared (LWIR) imaging is an imaging modality currently gaining increasing attention. Facial images acquired with LWIR sensors can be used for illumination invariant person recognition and the contactless extraction of vital signs such as respiratory rate. In order to work properly, these applications require a precise detection of faces and regions of interest such as eyes or nose. Most current facial landmark detectors in the LWIR spectrum localize single salient facial regions by thresholding. These approaches are not robust against out-of-plane rotation and occlusion. To address this problem, we therefore introduce a LWIR face tracking method based on an active appearance model (AAM). The model is trained with a manually annotated database of thermal face images. Additionally, we evaluate the effect of different methods for AAM generation and image preprocessing on the fitting performance. The method is evaluated on a set of still images and a video sequence. Results show that AAMs are a robust method for the detection and tracking of facial landmarks in the LWIR spectrum.

Paper Citation

in Harvard Style

Kopaczka M., Acar K. and Merhof D. (2016). Robust Facial Landmark Detection and Face Tracking in Thermal Infrared Images using Active Appearance Models . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 150-158. DOI: 10.5220/0005716801500158

in Bibtex Style

@conference{visapp16,
author={Marcin Kopaczka and Kemal Acar and Dorit Merhof},
title={Robust Facial Landmark Detection and Face Tracking in Thermal Infrared Images using Active Appearance Models},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={150-158},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005716801500158},
isbn={978-989-758-175-5},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)
TI - Robust Facial Landmark Detection and Face Tracking in Thermal Infrared Images using Active Appearance Models
SN - 978-989-758-175-5
AU - Kopaczka M.
AU - Acar K.
AU - Merhof D.
PY - 2016
SP - 150
EP - 158
DO - 10.5220/0005716801500158