Adding Model Constraints to CNN for Top View Hand Pose Recognition in Range Images

Aditya Tewari, Frederic Grandidier, Bertram Taetz, Didier Stricker

2016

Abstract

A new dataset for hand-pose is introduced. The dataset includes the top view images of the palm by Time of Flight (ToF) camera. It is recorded in an experimental setting with twelve participants for six hand-poses. An evaluation on the dataset is carried out with a dedicated Convolutional Neural Network (CNN) architecture for Hand Pose Recognition (HPR). This architecture uses a model-layer. The small size model layer creates a funnel shape network which adds a priori knowledge and constrains the network by modelling the degree of freedom of the palm, such that it learns palm features. It is demonstrated that this network performs better than a similar network without the prior added. A two-phase learning scheme which allows training the model on full dataset even when the classification problem is confined to a subset of the classes is described. The best model performs at an accuracy of 92%. Finally, we show the feature transfer capability of the network and compare the extracted features from various networks and discuss usefulness for various applications.

Paper Citation

in Harvard Style

Tewari A., Grandidier F., Taetz B. and Stricker D. (2016). Adding Model Constraints to CNN for Top View Hand Pose Recognition in Range Images . In Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM, ISBN 978-989-758-173-1, pages 170-177. DOI: 10.5220/0005660301700177

in Bibtex Style

@conference{icpram16,
author={Aditya Tewari and Frederic Grandidier and Bertram Taetz and Didier Stricker},
title={Adding Model Constraints to CNN for Top View Hand Pose Recognition in Range Images},
booktitle={Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,},
year={2016},
pages={170-177},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005660301700177},
isbn={978-989-758-173-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Pattern Recognition Applications and Methods - Volume 1: ICPRAM,
TI - Adding Model Constraints to CNN for Top View Hand Pose Recognition in Range Images
SN - 978-989-758-173-1
AU - Tewari A.
AU - Grandidier F.
AU - Taetz B.
AU - Stricker D.
PY - 2016
SP - 170
EP - 177
DO - 10.5220/0005660301700177