ON-LINE 3D BODY MODELLING FOR AUGMENTED REALITY

Luis Almeida, Paulo Menezes, Jorge Dias

2012

Abstract

Building 3D body models is an important task for virtual and augmented reality applications in telerehabilitation, education, 3DTV, entertainment and tele-presence. We propose a real-time full 3D reconstruction system that combines visual features and shape-based alignment using low cost depth sensor and video cameras targeting three-dimensional conferencing applications. With this approach we overcome the classic video based reconstruction problem in low-texture or repeated pattern regions. Alignment between successive frames is computed by jointly optimizing over both appearances and shape matching. Appearance-based alignment is done over 2D SURF features annotated with 3D position. Shape-based alignment is performed using the motion transformation estimation between consecutive annotated 3D point clouds through a linear method. A solution to avoid wrong annotated 3D matched points is proposed. 3D mesh model representation is used to lower the processed data and create a 3D representation that is independent of view-point.

Paper Citation

in Harvard Style

Almeida L., Menezes P. and Dias J. (2012). ON-LINE 3D BODY MODELLING FOR AUGMENTED REALITY . In Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012) ISBN 978-989-8565-02-0, pages 472-479. DOI: 10.5220/0003866304720479

in Bibtex Style

@conference{grapp12,
author={Luis Almeida and Paulo Menezes and Jorge Dias},
title={ON-LINE 3D BODY MODELLING FOR AUGMENTED REALITY},
booktitle={Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012)},
year={2012},
pages={472-479},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003866304720479},
isbn={978-989-8565-02-0},
}

in EndNote Style

TY - CONF
JO - Proceedings of the International Conference on Computer Graphics Theory and Applications and International Conference on Information Visualization Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2012)
TI - ON-LINE 3D BODY MODELLING FOR AUGMENTED REALITY
SN - 978-989-8565-02-0
AU - Almeida L.
AU - Menezes P.
AU - Dias J.
PY - 2012
SP - 472
EP - 479
DO - 10.5220/0003866304720479