Illumination Estimation and Relighting using an RGB-D Camera

Yohei Ogura, Takuya Ikeda, Francois de Sorbier, Hideo Saito

2015

Abstract

In this paper, we propose a relighting system combined with an illumination estimation method using RGBD camera. Relighting techniques can achieve the photometric registration of composite images. They often need illumination environments of the scene which include a target object and the background scene. Some relighting methods obtain the illumination environments beforehand. In this case, they cannot be used under the unknown dynamic illumination environment. Some on-line illumination estimation methods need light probes which can be invade the scene geometry. In our method, the illumination environment is estimated from pixel intensity, normal map and surface reflectance based on inverse rendering in on-line processing. The normal map of the arbitrary object which is used in the illumination estimation part and the relighting part is calculated from the denoised depth image on each frame. Relighting is achieved by calculating the ratio for the estimated Illumination environment of the each scene. Thus our implementation can be used for dynamic illumination or a dynamic object.

Paper Citation

in Harvard Style

Ogura Y., Ikeda T., de Sorbier F. and Saito H. (2015). Illumination Estimation and Relighting using an RGB-D Camera . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-090-1, pages 305-312. DOI: 10.5220/0005295403050312

in Bibtex Style

@conference{visapp15,
author={Yohei Ogura and Takuya Ikeda and Francois de Sorbier and Hideo Saito},
title={Illumination Estimation and Relighting using an RGB-D Camera},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={305-312},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005295403050312},
isbn={978-989-758-090-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: VISAPP, (VISIGRAPP 2015)
TI - Illumination Estimation and Relighting using an RGB-D Camera
SN - 978-989-758-090-1
AU - Ogura Y.
AU - Ikeda T.
AU - de Sorbier F.
AU - Saito H.
PY - 2015
SP - 305
EP - 312
DO - 10.5220/0005295403050312