Simultaneous Camera Calibration and Temporal Alignment of 2D and 3D Trajectories

Joni Herttuainen, Tuomas Eerola, Lasse Lensu, Heikki Kälviäinen

2017

Abstract

In this paper, we present an automatic method that given the 2D and 3D motion trajectories recorded with a camera and 3D sensor, automatically calibrates the camera with respect to the 3D sensor coordinates and aligns the trajectories with respect to time. The method utilizes a modified Random Sample Consensus (RANSAC) procedure that iteratively selects two points from both trajectories, uses them to calculate the scale and translation parameters for the temporal alignment, computes point correspondences, and estimates the camera matrix. We demonstrate the approach with a setup consisting of a standard web camera and Leap Motion sensor. We further propose necessary object tracking and trajectory filtering procedures to produce proper trajectories with the setup. The result showed that the proposed method achieves over 96% success rate with a test set of complex trajectories.

Paper Citation

in Harvard Style

Herttuainen J., Eerola T., Lensu L. and Kälviäinen H. (2017). Simultaneous Camera Calibration and Temporal Alignment of 2D and 3D Trajectories . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017) ISBN 978-989-758-227-1, pages 445-450. DOI: 10.5220/0006126304450450

in Bibtex Style

@conference{visapp17,
author={Joni Herttuainen and Tuomas Eerola and Lasse Lensu and Heikki Kälviäinen},
title={Simultaneous Camera Calibration and Temporal Alignment of 2D and 3D Trajectories},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)},
year={2017},
pages={445-450},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006126304450450},
isbn={978-989-758-227-1},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 6: VISAPP, (VISIGRAPP 2017)
TI - Simultaneous Camera Calibration and Temporal Alignment of 2D and 3D Trajectories
SN - 978-989-758-227-1
AU - Herttuainen J.
AU - Eerola T.
AU - Lensu L.
AU - Kälviäinen H.
PY - 2017
SP - 445
EP - 450
DO - 10.5220/0006126304450450