Direct Speech Generation for a Silent Speech Interface based on Permanent Magnet Articulography
Jose A. Gonzalez, Lam A. Cheah, James M. Gilbert, Jie Bai, Stephen R. Ell, Phil D. Green, Roger K. Moore
2016
Abstract
Patients with larynx cancer often lose their voice following total laryngectomy. Current methods for post-laryngectomy voice restoration are all unsatisfactory due to different reasons: requires frequent replacement due to biofilm growth (tracheo-oesoephageal valve), speech sounds gruff and masculine (oesophageal speech) or robotic (electro-larynx) and, in general, are difficult to master (oesophageal speech and electro-larynx). In this work we investigate an alternative approach for voice restoration in which speech articulator movement is converted into audible speech using a speaker-dependent transformation learned from simultaneous recordings of articulatory and audio signals. To capture articulator movement, small magnets are attached to the speech articulators and the magnetic field generated while the user `mouths' words is captured by a set of sensors. Parallel data comprising articulatory and acoustic signals recorded before laryngectomy are used to learn the mapping between the articulatory and acoustic domains, which is represented in this work as a mixture of factor analysers. After laryngectomy, the learned transformation is used to restore the patient's voice by transforming the captured articulator movement into an audible speech signal. Results reported for normal speakers show that the proposed system is very promising.
DownloadPaper Citation
in Harvard Style
Gonzalez J., Cheah L., Gilbert J., Bai J., Ell S., Green P. and Moore R. (2016). Direct Speech Generation for a Silent Speech Interface based on Permanent Magnet Articulography . In Proceedings of the 9th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 4: BIOSIGNALS, (BIOSTEC 2016) ISBN 978-989-758-170-0, pages 96-105. DOI: 10.5220/0005754100960105
in Bibtex Style
@conference{biosignals16,
author={Jose A. Gonzalez and Lam A. Cheah and James M. Gilbert and Jie Bai and Stephen R. Ell and Phil D. Green and Roger K. Moore},
title={Direct Speech Generation for a Silent Speech Interface based on Permanent Magnet Articulography},
booktitle={Proceedings of the 9th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 4: BIOSIGNALS, (BIOSTEC 2016)},
year={2016},
pages={96-105},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005754100960105},
isbn={978-989-758-170-0},
}
in EndNote Style
TY - CONF
JO - Proceedings of the 9th International Joint Conference on Biomedical Engineering Systems and Technologies - Volume 4: BIOSIGNALS, (BIOSTEC 2016)
TI - Direct Speech Generation for a Silent Speech Interface based on Permanent Magnet Articulography
SN - 978-989-758-170-0
AU - Gonzalez J.
AU - Cheah L.
AU - Gilbert J.
AU - Bai J.
AU - Ell S.
AU - Green P.
AU - Moore R.
PY - 2016
SP - 96
EP - 105
DO - 10.5220/0005754100960105