IMPROVING APPEARANCE-BASED 3D FACE TRACKING USING SPARSE STEREO DATA

Fadi Dornaika, Angel D. Sappa

2006

Abstract

Recently, researchers proposed deterministic and statistical appearance-based 3D head tracking methods which can successfully tackle the image variability and drift problems. However, appearance-based methods dedicated to 3D head tracking may suffer from inaccuracies since these methods are not very sensitive to out-of-plane motion variations. On the other hand, the use of dense 3D facial data provided by a stereo rig or a range sensor can provide very accurate 3D head motions/poses. However, this paradigm requires either an accurate facial feature extraction or a computationally expensive registration technique (e.g., the Iterative Closest Point algorithm). In this paper, we improve our appearance-based 3D face tracker by combining an adaptive appearance model with a robust 3D-to-3D registration technique that uses sparse stereo data. The resulting 3D face tracker combines the advantages of both appearance-based trackers and 3D data-based trackers while keeping the CPU time very close to that required by real-time trackers. We provide experiments and performance evaluation which show the feasibility and usefulness of the proposed approach.

Paper Citation

in Harvard Style

Dornaika F. and D. Sappa A. (2006). IMPROVING APPEARANCE-BASED 3D FACE TRACKING USING SPARSE STEREO DATA . In Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, ISBN 972-8865-40-6, pages 310-317. DOI: 10.5220/0001364003100317

in Bibtex Style

@conference{visapp06,
author={Fadi Dornaika and Angel D. Sappa},
title={IMPROVING APPEARANCE-BASED 3D FACE TRACKING USING SPARSE STEREO DATA},
booktitle={Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,},
year={2006},
pages={310-317},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001364003100317},
isbn={972-8865-40-6},
}

in EndNote Style

TY - CONF
JO - Proceedings of the First International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP,
TI - IMPROVING APPEARANCE-BASED 3D FACE TRACKING USING SPARSE STEREO DATA
SN - 972-8865-40-6
AU - Dornaika F.
AU - D. Sappa A.
PY - 2006
SP - 310
EP - 317
DO - 10.5220/0001364003100317