EVALUATION OF A USER-ADAPTED SPOKEN LANGUAGE DIALOGUE SYSTEM - Measuring the Relevance of the Contextual Information Sources

Juan Manuel Lucas-Cuesta, Fernando Fernández-Martínez, G. Dragos Rada, Syaheerah L. Lutfi, Javier Ferreiros

2011

Abstract

We present an evaluation of a spoken language dialogue system with a module for the management of user-related information, stored as user preferences and privileges. The flexibility of our dialogue management approach, based on Bayesian Networks (BN), together with a contextual information module, which performs different strategies for handling such information, allows us to include user information as a new level into the Context Manager hierarchy. We propose a set of objective and subjective metrics to measure the relevance of the different contextual information sources. The analysis of our evaluation scenarios shows that the relevance of the short-term information (i.e. the system status) remains pretty stable throughout the dialogue, whereas the dialogue history and the user profile (i.e. the middle-term and the long-term information, respectively) play a complementary role, evolving their usefulness as the dialogue evolves.

Paper Citation

in Harvard Style

Manuel Lucas-Cuesta J., Fernández-Martínez F., Dragos Rada G., L. Lutfi S. and Ferreiros J. (2011). EVALUATION OF A USER-ADAPTED SPOKEN LANGUAGE DIALOGUE SYSTEM - Measuring the Relevance of the Contextual Information Sources . In Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART, ISBN 978-989-8425-40-9, pages 218-223. DOI: 10.5220/0003140302180223

in Bibtex Style

@conference{icaart11,
author={Juan Manuel Lucas-Cuesta and Fernando Fernández-Martínez and G. Dragos Rada and Syaheerah L. Lutfi and Javier Ferreiros},
title={EVALUATION OF A USER-ADAPTED SPOKEN LANGUAGE DIALOGUE SYSTEM - Measuring the Relevance of the Contextual Information Sources},
booktitle={Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,},
year={2011},
pages={218-223},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003140302180223},
isbn={978-989-8425-40-9},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Conference on Agents and Artificial Intelligence - Volume 1: ICAART,
TI - EVALUATION OF A USER-ADAPTED SPOKEN LANGUAGE DIALOGUE SYSTEM - Measuring the Relevance of the Contextual Information Sources
SN - 978-989-8425-40-9
AU - Manuel Lucas-Cuesta J.
AU - Fernández-Martínez F.
AU - Dragos Rada G.
AU - L. Lutfi S.
AU - Ferreiros J.
PY - 2011
SP - 218
EP - 223
DO - 10.5220/0003140302180223