GPU-accelerated Multi-sensor 3D Mapping for Remote Control of Mobile Robots using Virtual Reality

Sebastian P. Kleinschmidt, Bernardo Wagner

2016

Abstract

In this paper, a new virtual reality (VR) control concept for operating robots in search and rescue (SAR) scenarios is introduced. The presented approach intuitively provides different sensor signals as RGB, thermal and active infrared images by projecting them onto 3D structures generated by a Time of Flight (ToF)-based depth camera. The multichannel 3D data are displayed using an Oculus Rift head-up-display providing additional head tracking information. The usage of 3D structures can improve the perception of scale and depth by providing stereoscopic images which cannot be generated for stand-alone 2D images. Besides the described operating concept, the main contributions of this paper are the introduction of an hybrid calibration pattern for multi-sensor calibration and a high performance 2D-to-3D mapping procedure. To ensure low latencies, all steps of the algorithm are performed parallelly on a graphics processing unit (GPU) which reduces the traditional processing time on a central processing unit (CPU) by 80.03%. Furthermore, different input images are merged according to their importance for the operator to create a multi-sensor point cloud.

Paper Citation

in Harvard Style

Kleinschmidt S. and Wagner B. (2016). GPU-accelerated Multi-sensor 3D Mapping for Remote Control of Mobile Robots using Virtual Reality . In Proceedings of the 13th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO, ISBN 978-989-758-198-4, pages 19-29. DOI: 10.5220/0005692200190029

in Bibtex Style

@conference{icinco16,
author={Sebastian P. Kleinschmidt and Bernardo Wagner},
title={GPU-accelerated Multi-sensor 3D Mapping for Remote Control of Mobile Robots using Virtual Reality},
booktitle={Proceedings of the 13th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,},
year={2016},
pages={19-29},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005692200190029},
isbn={978-989-758-198-4},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 13th International Conference on Informatics in Control, Automation and Robotics - Volume 2: ICINCO,
TI - GPU-accelerated Multi-sensor 3D Mapping for Remote Control of Mobile Robots using Virtual Reality
SN - 978-989-758-198-4
AU - Kleinschmidt S.
AU - Wagner B.
PY - 2016
SP - 19
EP - 29
DO - 10.5220/0005692200190029