AR Visualization of Thermal 3D Model by Hand-held Cameras

Kazuki Matsumoto, Wataru Nakagawa, Hideo Saito, Maki Sugimoto, Takashi Shibata, Shoji Yachida

2015

Abstract

In this paper, we propose a system for AR visualization of thermal distribution on the environment. Our system is based on color 3D model and thermal 3D model of the target scene generated by KinectFusion using a thermal camera coupled with an RGB-D camera. In off-line phase, Viewpoint Generative Learning (VGL) is applied to the colored 3D model for collecting its stable keypoints descriptors. Those descriptors are utilized in camera pose initialization at the start of on-line phase. After that, our proposed camera tracking which combines frame-to-frame camera tracking with VGL based tacking is performed for accurate estimation of the camera pose. From estimated camera pose, the thermal 3D model is finally superimposed to current mobile camera view. As a result, we can observe the wide area thermal map from any viewpoint. Our system is applied for a temperature change visualization system with a thermal camera coupled with an RGB-D camera and it is also enables the smartphone to interactively display thermal distribution of a given scene.

Paper Citation

in Harvard Style

Matsumoto K., Nakagawa W., Saito H., Sugimoto M., Shibata T. and Yachida S. (2015). AR Visualization of Thermal 3D Model by Hand-held Cameras . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-091-8, pages 480-487. DOI: 10.5220/0005290904800487

in Bibtex Style

@conference{visapp15,
author={Kazuki Matsumoto and Wataru Nakagawa and Hideo Saito and Maki Sugimoto and Takashi Shibata and Shoji Yachida},
title={AR Visualization of Thermal 3D Model by Hand-held Cameras},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={480-487},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005290904800487},
isbn={978-989-758-091-8},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)
TI - AR Visualization of Thermal 3D Model by Hand-held Cameras
SN - 978-989-758-091-8
AU - Matsumoto K.
AU - Nakagawa W.
AU - Saito H.
AU - Sugimoto M.
AU - Shibata T.
AU - Yachida S.
PY - 2015
SP - 480
EP - 487
DO - 10.5220/0005290904800487