RGB-D and Thermal Sensor Fusion - Application in Person Tracking

Ignacio Rocco Spremolla, Michel Antunes, Djamila Aouada, Björn Ottersten

2016

Abstract

Many systems combine RGB cameras with other sensor modalities for fusing visual data with complementary environmental information in order to achieve improved sensing capabilities. This article explores the possibility of fusing a commodity RGB-D camera and a thermal sensor. We show that using traditional methods, it is possible to accurately calibrate the complete system and register the three RGB-D-T data sources. We propose a simple person tracking algorithm based on particle filters, and show how to combine the mapped pixel information from the RGB-D-T data. Furthermore, we use depth information to adaptively scale the tracked target area when radial displacements from the camera occur. Experimental results provide evidence that this allows for a significant tracking performance improvement in situations with large radial displacements, when compared to using only a tracker based on RGB or RGB-T data.

Paper Citation

in Harvard Style

Rocco Spremolla I., Antunes M., Aouada D. and Ottersten B. (2016). RGB-D and Thermal Sensor Fusion - Application in Person Tracking . In Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016) ISBN 978-989-758-175-5, pages 610-617. DOI: 10.5220/0005717706100617

in Bibtex Style

@conference{visapp16,
author={Ignacio Rocco Spremolla and Michel Antunes and Djamila Aouada and Björn Ottersten},
title={RGB-D and Thermal Sensor Fusion - Application in Person Tracking},
booktitle={Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)},
year={2016},
pages={610-617},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005717706100617},
isbn={978-989-758-175-5},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 11th Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2016)
TI - RGB-D and Thermal Sensor Fusion - Application in Person Tracking
SN - 978-989-758-175-5
AU - Rocco Spremolla I.
AU - Antunes M.
AU - Aouada D.
AU - Ottersten B.
PY - 2016
SP - 610
EP - 617
DO - 10.5220/0005717706100617