Semi-automatic Hand Annotation Making Human-human Interaction Analysis Fast and Accurate

Stijn De Beugher, Geert Brône, Toon Goedemé

2016

Abstract

The detection of human hands is of great importance in a variety of domains including research on humancomputer interaction, human-human interaction, sign language and physiotherapy. Within this field of research one is interested in relevant items in recordings, such as for example faces, human body or hands. However, nowadays this annotation is mainly done manual, which makes this task extremely time consuming. In this paper, we present a semi-automatic alternative for the manual labeling of recordings. Our system automatically searches for hands in images and asks for manual intervention if the confidence of a detection is too low. Most of the existing approaches rely on complex and computationally intensive models to achieve accurate hand detections, while our approach is based on segmentation techniques, smart tracking mechanisms and knowledge of human pose context. This makes our approach substantially faster as compared to existing approaches. In this paper we apply our semi-automatic hand detection to the annotation of mobile eye-tracker recordings on human-human interaction. Our system makes the analysis of such data tremendously faster (244×) while maintaining an average accuracy of 93.68% on the tested datasets.

Paper Citation

in Harvard Style

Beugher S., Brône G. and Goedemé T. (2016). Semi-automatic Hand Annotation Making Human-human Interaction Analysis Fast and Accurate . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 552-559. DOI: 10.5220/0005718505520559

in Bibtex Style

@conference{visapp16,
author={Stijn De Beugher and Geert Brône and Toon Goedemé},
title={Semi-automatic Hand Annotation Making Human-human Interaction Analysis Fast and Accurate},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={552-559},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005718505520559},
isbn={978-989-758-175-5},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)
TI - Semi-automatic Hand Annotation Making Human-human Interaction Analysis Fast and Accurate
SN - 978-989-758-175-5
AU - Beugher S.
AU - Brône G.
AU - Goedemé T.
PY - 2016
SP - 552
EP - 559
DO - 10.5220/0005718505520559