KinFu MOT: KinectFusion with Moving Objects Tracking

Michael Korn, Josef Pauli

2015

Abstract

Using a depth camera, the KinectFusion algorithm permits tracking the camera poses and building a dense 3D reconstruction of the environment simultaneously in real-time. We present an extension to this algorithm that allows additionally the concurrent tracking and reconstruction of several moving objects within the perceived environment. This is achieved through an expansion of the GPU processing pipeline by several new functionalities. Our system detects moving objects from the registration results and it creates a separate storing volume for such objects. Each object and the background are tracked and reconstructed individually. Since the size of an object is uncertain at the moment of detection the storing volume grows dynamically. Moreover, a sliding reduction method stabilizes the tracking of objects with ambiguous registrations. We provide experimental results showing the effects of our modified matching strategy. Furthermore, we demonstrate the system’s ability to deal with three different challenging situations containing a moving robot.

Paper Citation

in Harvard Style

Korn M. and Pauli J. (2015). KinFu MOT: KinectFusion with Moving Objects Tracking . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015) ISBN 978-989-758-091-8, pages 648-657. DOI: 10.5220/0005362106480657

in Bibtex Style

@conference{visapp15,
author={Michael Korn and Josef Pauli},
title={KinFu MOT: KinectFusion with Moving Objects Tracking},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)},
year={2015},
pages={648-657},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005362106480657},
isbn={978-989-758-091-8},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 3: VISAPP, (VISIGRAPP 2015)
TI - KinFu MOT: KinectFusion with Moving Objects Tracking
SN - 978-989-758-091-8
AU - Korn M.
AU - Pauli J.
PY - 2015
SP - 648
EP - 657
DO - 10.5220/0005362106480657