MULTIMODAL COMMUNICATION ERROR DETECTION FOR DRIVER-CAR INTERACTION

Sy Bor Wang, David Demirdjian, Trevor Darrell, Hedvig Kjellström

2007

Abstract

Speech recognition systems are now used in a wide variety of domains. They have recently been introduced in cars for hand-free control of radio, cell-phone and navigation applications. However, due to the ambient noise in the car recognition errors are relatively frequent. This paper tackles the problem of detecting when such recognition errors occur from the driver’s reaction. Automatic detection of communication errors in dialogue-based systems has been explored extensively in the speech community. The detection is most often based on prosody cues such as intensity and pitch. However, recent perceptual studies indicate that the detection can be improved significantly if both acoustic and visual modalities are taken into account. To this end, we present a framework for automatic audio-visual detection of communication errors.

Paper Citation

in Harvard Style

Bor Wang S., Demirdjian D., Darrell T. and Kjellström H. (2007). MULTIMODAL COMMUNICATION ERROR DETECTION FOR DRIVER-CAR INTERACTION . In Proceedings of the Fourth International Conference on Informatics in Control, Automation and Robotics - Volume 2: IVCS, (ICINCO 2007) ISBN 978-972-8865-83-2, pages 365-371. DOI: 10.5220/0001637603650371

in Bibtex Style

@conference{ivcs07,
author={Sy Bor Wang and David Demirdjian and Trevor Darrell and Hedvig Kjellström},
title={MULTIMODAL COMMUNICATION ERROR DETECTION FOR DRIVER-CAR INTERACTION},
booktitle={Proceedings of the Fourth International Conference on Informatics in Control, Automation and Robotics - Volume 2: IVCS, (ICINCO 2007)},
year={2007},
pages={365-371},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001637603650371},
isbn={978-972-8865-83-2},
}

in EndNote Style

TY - CONF
JO - Proceedings of the Fourth International Conference on Informatics in Control, Automation and Robotics - Volume 2: IVCS, (ICINCO 2007)
TI - MULTIMODAL COMMUNICATION ERROR DETECTION FOR DRIVER-CAR INTERACTION
SN - 978-972-8865-83-2
AU - Bor Wang S.
AU - Demirdjian D.
AU - Darrell T.
AU - Kjellström H.
PY - 2007
SP - 365
EP - 371
DO - 10.5220/0001637603650371