Feedback Design in Multimodal Dialogue Systems

Peter Van Rosmalen, Dirk Börner, Jan Schneider, Olga Petukhova, Joy van Helvert

2015

Abstract

This paper discusses the design and development of the instructional aspects of a multimodal dialogue system to train youth parliament members’ presentation and debating skills. Real-time, in-action feedback informs learners on the fly how they perform key skills and enables them to adapt instantly. About-action feedback informs learners after finishing a task how they perform key skills and enables them to monitor their progress and adapt accordingly in subsequent tasks. In- and about-action feedback together support the enhancement of the learners’ metacognitive skills, such as self-monitoring, self-regulation and self-reflection thus reflect in- and about action. We discusses the theoretical considerations of the feedback, the type of data available and different ways to analyse and combine them, the timing of feedback and, finally, provide an instructional design blueprint giving a global outline of a set of tasks with stepwise increasing complexity and the feedback proposed. We conclude with the results of the first experiment with the system focussing on non-verbal communication skills.

Paper Citation

in Harvard Style

Van Rosmalen P., Börner D., Schneider J., Petukhova O. and van Helvert J. (2015). Feedback Design in Multimodal Dialogue Systems . In Proceedings of the 7th International Conference on Computer Supported Education - Volume 2: CSEDU, ISBN 978-989-758-108-3, pages 209-217. DOI: 10.5220/0005423102090217

in Bibtex Style

@conference{csedu15,
author={Peter Van Rosmalen and Dirk Börner and Jan Schneider and Olga Petukhova and Joy van Helvert},
title={Feedback Design in Multimodal Dialogue Systems},
booktitle={Proceedings of the 7th International Conference on Computer Supported Education - Volume 2: CSEDU,},
year={2015},
pages={209-217},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005423102090217},
isbn={978-989-758-108-3},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 7th International Conference on Computer Supported Education - Volume 2: CSEDU,
TI - Feedback Design in Multimodal Dialogue Systems
SN - 978-989-758-108-3
AU - Van Rosmalen P.
AU - Börner D.
AU - Schneider J.
AU - Petukhova O.
AU - van Helvert J.
PY - 2015
SP - 209
EP - 217
DO - 10.5220/0005423102090217