Measuring the Latency of an Augmented Reality System for Robot-assisted Minimally Invasive Surgery

Martin Kibsgaard, Martin Kraus

2017

Abstract

Minimal latency is important for augmented reality systems and teleoperation interfaces as even small increases in latency can affect user performance. Previously, we have developed an augmented reality system that can overlay stereoscopic video streams with computer graphics in order to improve visual communication in training for robot-assisted minimally invasive surgery with da Vinci surgical systems. To make sure that our augmented reality system provides the best possible user experience, we investigated the video latency of the da Vinci surgical system and how the components of our system affect the overall latency. To measure the photon-to-photon latency, we used a microcontroller to determine the time between the activation of a light-emitting diode in front of the endoscopic camera and the corresponding increase in intensity of the surgeon’s display as measured by a phototransistor. The latency of the da Vinci S surgical system was on average 62 ms. None of the components of our overlay system (separately or combined) significantly affected the latency. However, the latency of the assistant’s monitor increased by 14 ms. Passing the video streams through CPU or GPU memory increased the latency to 147 ms and 256 ms, respectively.

Paper Citation

in Harvard Style

Kibsgaard M. and Kraus M. (2017). Measuring the Latency of an Augmented Reality System for Robot-assisted Minimally Invasive Surgery . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017) ISBN 978-989-758-224-0, pages 321-326. DOI: 10.5220/0006274203210326

in Bibtex Style

@conference{grapp17,
author={Martin Kibsgaard and Martin Kraus},
title={Measuring the Latency of an Augmented Reality System for Robot-assisted Minimally Invasive Surgery},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017)},
year={2017},
pages={321-326},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006274203210326},
isbn={978-989-758-224-0},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 1: GRAPP, (VISIGRAPP 2017)
TI - Measuring the Latency of an Augmented Reality System for Robot-assisted Minimally Invasive Surgery
SN - 978-989-758-224-0
AU - Kibsgaard M.
AU - Kraus M.
PY - 2017
SP - 321
EP - 326
DO - 10.5220/0006274203210326