A MOBILE CONVERSATION ASSISTANT TO ENHANCE COMMUNICATIONS FOR HEARING-IMPAIRED CHILDREN

Toon De Pessemier, Laurens Van Acker, Emilie Van Dijck, Karin Slegers, Wout Joseph, Luc Martens

2012

Abstract

Children and young people who are deaf or have hearing impairments do not master the spoken and written language well. Moreover, their friends and relatives do not always speak sign language. In this research, a communication aid is developed on the Google Android mobile operating system to reduce these barriers by converting text into relevant images and movies thereby clarifying the meaning of the text. Users can select text from webpages, e-mail and SMS messages, or text can be generated using speech recognition or optical character recognition as input source. The communication tool analyzes the sentences and tries to understand the context and meaning of the text in order to select the most appropriate visual content originating from online sources like YouTube, Flickr, Google Images, and Vimeo. User tests and focus groups with deaf children and interviews with experts in the field of deaf and hard hearing people confirmed the need for a communication aid and proved the utility of the proposed tool.

Paper Citation

in Harvard Style

De Pessemier T., Van Acker L., Van Dijck E., Slegers K., Joseph W. and Martens L. (2012). A MOBILE CONVERSATION ASSISTANT TO ENHANCE COMMUNICATIONS FOR HEARING-IMPAIRED CHILDREN . In Proceedings of the 8th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST, ISBN 978-989-8565-08-2, pages 775-780. DOI: 10.5220/0003934607750780

in Bibtex Style

@conference{webist12,
author={Toon De Pessemier and Laurens Van Acker and Emilie Van Dijck and Karin Slegers and Wout Joseph and Luc Martens},
title={A MOBILE CONVERSATION ASSISTANT TO ENHANCE COMMUNICATIONS FOR HEARING-IMPAIRED CHILDREN},
booktitle={Proceedings of the 8th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,},
year={2012},
pages={775-780},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0003934607750780},
isbn={978-989-8565-08-2},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 8th International Conference on Web Information Systems and Technologies - Volume 1: WEBIST,
TI - A MOBILE CONVERSATION ASSISTANT TO ENHANCE COMMUNICATIONS FOR HEARING-IMPAIRED CHILDREN
SN - 978-989-8565-08-2
AU - De Pessemier T.
AU - Van Acker L.
AU - Van Dijck E.
AU - Slegers K.
AU - Joseph W.
AU - Martens L.
PY - 2012
SP - 775
EP - 780
DO - 10.5220/0003934607750780