Automated Classification of Therapeutic Face Exercises using the Kinect

Cornelia Lanz, Birant Sibel Olgay, Joachim Denzler, Horst-Michael Gross

2013

Abstract

In this work, we propose an approach for the unexplored topic of therapeutic facial exercise recognition using depth images. In cooperation with speech therapists, we determined nine exercises that are beneficial for therapy of patients suffering from dysfunction of facial movements. Our approach employs 2.5D images and 3D point clouds, which were recorded using Microsoft’s Kinect. Extracted features comprise the curvature of the face surface and characteristic profiles that are derived using distinctive landmarks. We evaluate the discriminative power and the robustness of the features with respect to the above-mentioned application scenario. Using manually located face regions for feature extraction, we achieve an average recognition accuracy of about 91% for the nine facial exercises. However in a real-world scenario manual localization of regions for feature extraction is not feasible. Therefore, we additionally examine the robustness of the features and show, that they are beneficial for a real-world, fully automated scenario as well.

Paper Citation

in Harvard Style

Lanz C., Olgay B., Denzler J. and Gross H. (2013). Automated Classification of Therapeutic Face Exercises using the Kinect . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013) ISBN 978-989-8565-47-1, pages 556-565. DOI: 10.5220/0004294005560565

in Bibtex Style

@conference{visapp13,
author={Cornelia Lanz and Birant Sibel Olgay and Joachim Denzler and Horst-Michael Gross},
title={Automated Classification of Therapeutic Face Exercises using the Kinect},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)},
year={2013},
pages={556-565},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004294005560565},
isbn={978-989-8565-47-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)
TI - Automated Classification of Therapeutic Face Exercises using the Kinect
SN - 978-989-8565-47-1
AU - Lanz C.
AU - Olgay B.
AU - Denzler J.
AU - Gross H.
PY - 2013
SP - 556
EP - 565
DO - 10.5220/0004294005560565