Good Practices on Hand Gestures Recognition for the Design of Customized NUI

Damiano Malafronte, Nicoletta Noceti

2015

Abstract

In this paper we consider the problem of recognizing dynamic human gestures in the context of human-machine interaction. We are particularly interested to the so-called Natural User Interfaces, a new modality based on a more natural and intuitive way of interacting with a digital device. In our work, a user can interact with a system by performing a set of encoded hand gestures in front of a webcam. We designed a method that first classifies hand poses guided by a finger detection procedure, and then recognizes known gestures with a syntactic approach. To this purpose, we collected a sequence of hand poses over time, to build a linguistic gesture description. The known gestures are formalized using a generative grammar. Then, at runtime, a parser allows us to perform gesture recognition leveraging on the production rules of the grammar. As for finger detection, we propose a new method which starts from a distance transform of the hand region and iteratively scans such region according to the distance values moving from a fingertip to the hand palm. We experimentally validated our approach, showing both the hand pose classification and gesture recognition performances.

Paper Citation

in Harvard Style

Malafronte D. and Noceti N. (2015). Good Practices on Hand Gestures Recognition for the Design of Customized NUI . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-090-1, pages 360-367. DOI: 10.5220/0005304203600367

in Bibtex Style

@conference{visapp15,
author={Damiano Malafronte and Nicoletta Noceti},
title={Good Practices on Hand Gestures Recognition for the Design of Customized NUI},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={360-367},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005304203600367},
isbn={978-989-758-090-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015)
TI - Good Practices on Hand Gestures Recognition for the Design of Customized NUI
SN - 978-989-758-090-1
AU - Malafronte D.
AU - Noceti N.
PY - 2015
SP - 360
EP - 367
DO - 10.5220/0005304203600367