Multispectral Data Fusion for Robotic Reconnaissance and Mapping

Petra Kocmanova, Ludek Zalud, Frantisek Burian, Tomas Jilek

2014

Abstract

The aim of the paper is to describe the data-fusion from optical sensors for mobile robotics reconnaissance and mapping. Data are acquired by stereo pair of CCD cameras, stereo pair of thermal imagers, and TOF (time-of-flight) camera. The fusion is realized by means of spatial data from a TOF camera to ensure "natural" representation of a robot’s environment; thus, the thermal and CCD camera data are comprised in one stereo image presented to a binocular, head-mounted display. The data acquisition is performed using a sensor head, which is placed on an Orpheus-X3 robot; both the head and the robot were developed by our working group. After the geometrical calibration of each sensor, the positions of the sensors in 6DOFs are computed. The corresponding data from the CCD camera and the thermal imager are subsequently determined via homogeneous and perspective transformations. The result consists in an image containing aligned data from the CCD camera and the thermal imager for each eye. TOF camera calibration and its impact to the precision of fusion is described. Although the fusion is used for two different tasks – automatic environment mapping and visual telepresence, the utilised calibration and fusion algorithms are, in principle, the same.

Paper Citation

in Harvard Style

Kocmanova P., Zalud L., Burian F. and Jilek T. (2014). Multispectral Data Fusion for Robotic Reconnaissance and Mapping . In Proceedings of the 11th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-758-040-6, pages 459-466. DOI: 10.5220/0005060504590466

in Bibtex Style

@conference{icinco14,
author={Petra Kocmanova and Ludek Zalud and Frantisek Burian and Tomas Jilek},
title={Multispectral Data Fusion for Robotic Reconnaissance and Mapping},
booktitle={Proceedings of the 11th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2014},
pages={459-466},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005060504590466},
isbn={978-989-758-040-6},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 11th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - Multispectral Data Fusion for Robotic Reconnaissance and Mapping
SN - 978-989-758-040-6
AU - Kocmanova P.
AU - Zalud L.
AU - Burian F.
AU - Jilek T.
PY - 2014
SP - 459
EP - 466
DO - 10.5220/0005060504590466