A Novel Human Interaction Game-like Application to Learn, Perform and Evaluate Modern Contemporary Singing - "Human Beat Box"

S. K. Al Kork, D. Uğurca, C. Şahin, P. Chawah, L. Buchman, M. Adda-Decker, K. Xu, B. Denby, P. Roussel, B. Picart, S. Dupont, F. Tsalakanidou, A. Kitsikidis, F. M. Dagnino, M. Ott, F. Pozzi, M. Stone, E. Yilmaz

2015

Abstract

The paper presents an interactive game-like application to learn, perform and evaluate modern contemporary singing. The Human Beat Box (HBB) is being used as a case study. The game consists of two main modules. A sensor module that consists of a portable helmet based system containing an ultrasonic (US) transducer to capture tongue movements, a video camera for the lips, Kinect camera for face gestures, and a microphone for sound. A 3D environment game module is used to visualize a 3D recording studio as game world with all of its unique elements like guitars, mixer, amplifier, speakers and a microphone in front of the 3D avatar to simulate the recording ambience. The game also features a 2D virtual tutor to help the learner by giving oral and written feedback during the game. He also gives feedbacks during the practice session to improve the student’s performance. The game is still at its early stages of development and it is been tested using simple HBB plosive sounds for percussion such as “PTK”.

Download


Paper Citation


in Harvard Style

Al Kork S., Uğurca D., Şahin C., Chawah P., Buchman L., Adda-Decker M., Xu K., Denby B., Roussel P., Picart B., Dupont S., Tsalakanidou F., Kitsikidis A., Dagnino F., Ott M., Pozzi F., Stone M. and Yilmaz E. (2015). A Novel Human Interaction Game-like Application to Learn, Perform and Evaluate Modern Contemporary Singing - "Human Beat Box" . In Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: MMS-ER3D, (VISIGRAPP 2015) ISBN 978-989-758-090-1, pages 640-650. DOI: 10.5220/0005429506400650

in Bibtex Style

@conference{mms-er3d15,
author={S. K. Al Kork and D. Uğurca and C. Şahin and P. Chawah and L. Buchman and M. Adda-Decker and K. Xu and B. Denby and P. Roussel and B. Picart and S. Dupont and F. Tsalakanidou and A. Kitsikidis and F. M. Dagnino and M. Ott and F. Pozzi and M. Stone and E. Yilmaz},
title={A Novel Human Interaction Game-like Application to Learn, Perform and Evaluate Modern Contemporary Singing - "Human Beat Box"},
booktitle={Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: MMS-ER3D, (VISIGRAPP 2015)},
year={2015},
pages={640-650},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005429506400650},
isbn={978-989-758-090-1},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 10th International Conference on Computer Vision Theory and Applications - Volume 2: MMS-ER3D, (VISIGRAPP 2015)
TI - A Novel Human Interaction Game-like Application to Learn, Perform and Evaluate Modern Contemporary Singing - "Human Beat Box"
SN - 978-989-758-090-1
AU - Al Kork S.
AU - Uğurca D.
AU - Şahin C.
AU - Chawah P.
AU - Buchman L.
AU - Adda-Decker M.
AU - Xu K.
AU - Denby B.
AU - Roussel P.
AU - Picart B.
AU - Dupont S.
AU - Tsalakanidou F.
AU - Kitsikidis A.
AU - Dagnino F.
AU - Ott M.
AU - Pozzi F.
AU - Stone M.
AU - Yilmaz E.
PY - 2015
SP - 640
EP - 650
DO - 10.5220/0005429506400650