A Multiresolution 3D Morphable Face Model and Fitting Framework

Patrik Huber, Guosheng Hu, Rafael Tena, Pouria Mortazavian, Willem P. Koppen, William J. Christmas, Matthias Rätsch, Josef Kittler

2016

Abstract

3D Morphable Face Models are a powerful tool in computer vision. They consists of a PCA model of face shape and colour information and allow to reconstruct a 3D face from a single 2D image. 3D Morphable Face Models are used for 3D head pose estimation, face analysis, face recognition, and, more recently, facial landmark detection and tracking. However, they are not as widely used as 2D methods - the process of building and using a 3D model is much more involved. In this paper, we present the Surrey Face Model, a multi-resolution 3D Morphable Model that we make available to the public for non-commercial purposes. The model contains different mesh resolution levels and landmark point annotations as well as metadata for texture remapping. Accompanying the model is a lightweight open-source C++ library designed with simplicity and ease of integration as its foremost goals. In addition to basic functionality, it contains pose estimation and face frontalisation algorithms. With the tools presented in this paper, we aim to close two gaps. First, by offering different model resolution levels and fast fitting functionality, we enable the use of a 3D Morphable Model in time-critical applications like tracking. Second, the software library makes it easy for the community to adopt the 3D Morphable Face Model in their research, and it offers a public place for collaboration.

Paper Citation

in Harvard Style

Huber P., Hu G., Tena R., Mortazavian P., Koppen W., Christmas W., Rätsch M. and Kittler J. (2016). A Multiresolution 3D Morphable Face Model and Fitting Framework . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 79-86. DOI: 10.5220/0005669500790086

in Bibtex Style

@conference{visapp16,
author={Patrik Huber and Guosheng Hu and Rafael Tena and Pouria Mortazavian and Willem P. Koppen and William J. Christmas and Matthias Rätsch and Josef Kittler},
title={A Multiresolution 3D Morphable Face Model and Fitting Framework},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={79-86},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005669500790086},
isbn={978-989-758-175-5},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 4: VISAPP, (VISIGRAPP 2016)
TI - A Multiresolution 3D Morphable Face Model and Fitting Framework
SN - 978-989-758-175-5
AU - Huber P.
AU - Hu G.
AU - Tena R.
AU - Mortazavian P.
AU - Koppen W.
AU - Christmas W.
AU - Rätsch M.
AU - Kittler J.
PY - 2016
SP - 79
EP - 86
DO - 10.5220/0005669500790086