Vision-based Hand Pose Estimation - A Mixed Bottom-up and Top-down Approach

Davide Periquito, Jacinto C. Nascimento, Alexandre Bernardino, João Sequeira

2013

Abstract

Tracking a human hand position and orientation in image sequences is nowadays possible with local search methods, given that a good initialization is provided and that the hand pose and appearance have small frame-to-frame changes. However, if the target moves too quickly or disappears from the field of view, reinitialization of the tracker is necessary. Fully automatic initialization is a very challenging problem due to multiple factors, including the difficulty in identifying landmarks on individual fingers and reconstructing the hand pose from their position. In this paper, we propose an appearance based approach to generate candidates for hand postures given a single image. The method is based on matching hand silhouettes to a previously trained database, therefore circumventing the need for explicit geometric pose reconstruction. A dense sampling of the hand appearance space is obtained through a simulation environment and the corresponding silhouettes stored in a database. In run time, the acquired silhouettes are efficiently retrieved from the database using a mixture of bottom-up and top-down processes. We assess the performance of our approach in a series of simulations, evaluating the influence of the bottom-up and top-down processes in terms of estimation error and computation time, and show promising results obtained with real sequences.

Paper Citation

in Harvard Style

Periquito D., Nascimento J., Bernardino A. and Sequeira J. (2013). Vision-based Hand Pose Estimation - A Mixed Bottom-up and Top-down Approach . In Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013) ISBN 978-989-8565-47-1, pages 566-573. DOI: 10.5220/0004295805660573

in Bibtex Style

@conference{visapp13,
author={Davide Periquito and Jacinto C. Nascimento and Alexandre Bernardino and João Sequeira},
title={Vision-based Hand Pose Estimation - A Mixed Bottom-up and Top-down Approach},
booktitle={Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)},
year={2013},
pages={566-573},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004295805660573},
isbn={978-989-8565-47-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Vision Theory and Applications - Volume 1: VISAPP, (VISIGRAPP 2013)
TI - Vision-based Hand Pose Estimation - A Mixed Bottom-up and Top-down Approach
SN - 978-989-8565-47-1
AU - Periquito D.
AU - Nascimento J.
AU - Bernardino A.
AU - Sequeira J.
PY - 2013
SP - 566
EP - 573
DO - 10.5220/0004295805660573