FACIAL ANIMATION WITH MOTION CAPTURE BASED ON SURFACE BLENDING

Lijia Zhu, Won-Sook Lee

2007

Abstract

This paper proposes a methodology to reconstruct 3D facial expressions with motion capture data. Feature-point based facial animation provides easy control of expression usually by moving surface points using mathematical deformation. However it does not support the high quality of surface animation of the face where the feature points are not present. In this paper, we focus on animating a 3D facial model using only feature points, but keeping the high quality animation by using an expression databank obtained from surface scanning. Firstly, a facial expression databank is prepared by processing raw laser-scanned human face data with a consistent parameterization technique. Secondly, sparse motion capture data is obtained using an optical tracking system. Thirdly, guided by the captured MPEG-4 feature point motions, we find the corresponding surface information in the existing examples in the databank by linear combination of them. The optimized blending weights are obtained implicitly by Genetic Algorithms (GA). Finally, the surface blending result is retargeted into the performer’s neutral facial mesh. Consequently, motions of the facial surface points are reconstructed.

Paper Citation

in Harvard Style

Zhu L. and Lee W. (2007). FACIAL ANIMATION WITH MOTION CAPTURE BASED ON SURFACE BLENDING . In Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 2: GRAPP, ISBN 978-972-8865-72-6, pages 63-68. DOI: 10.5220/0002083700630068

in Bibtex Style

@conference{grapp07,
author={Lijia Zhu and Won-Sook Lee},
title={FACIAL ANIMATION WITH MOTION CAPTURE BASED ON SURFACE BLENDING},
booktitle={Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 2: GRAPP,},
year={2007},
pages={63-68},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0002083700630068},
isbn={978-972-8865-72-6},
}

in EndNote Style

TY - CONF
JO - Proceedings of the Second International Conference on Computer Graphics Theory and Applications - Volume 2: GRAPP,
TI - FACIAL ANIMATION WITH MOTION CAPTURE BASED ON SURFACE BLENDING
SN - 978-972-8865-72-6
AU - Zhu L.
AU - Lee W.
PY - 2007
SP - 63
EP - 68
DO - 10.5220/0002083700630068