Multisensory Analytics: Case of Visual-auditory Analysis of Scalar Fields

E. Malikova, V. Pilyugin, V. Adzhiev, G. Pasko, A. Pasko

2017

Abstract

A well-known definition of visualization is the mapping of initial data to a visual representation, which can be perceived and interpreted by humans. Human senses include not only vision, but also hearing, sense of touch, smell and others including their combinations. Visual analytics and its more general version that we call Multisensory Analytics are areas that consider visualization as one of its components. We present a particular case of the multisensory analytics with a hybrid visual-auditory representation of data to show how auditory display can be used in the context of data analysis. Some generalizations based on using real-valued vector functions for solving data analysis problems by means of multisensory analytics are proposed. These generalizations might be considered as a first step to formalization of the correspondence between the initial data and various sensory stimuli. An illustration of our approach with a case study of analysis of a scalar field using both visual and auditory data representations is given.

Paper Citation

in Harvard Style

Malikova E., Pilyugin V., Adzhiev V., Pasko G. and Pasko A. (2017). Multisensory Analytics: Case of Visual-auditory Analysis of Scalar Fields . In Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: IVAPP, (VISIGRAPP 2017) ISBN 978-989-758-228-8, pages 322-329. DOI: 10.5220/0006255003220329

in Bibtex Style

@conference{ivapp17,
author={E. Malikova and V. Pilyugin and V. Adzhiev and G. Pasko and A. Pasko},
title={Multisensory Analytics: Case of Visual-auditory Analysis of Scalar Fields},
booktitle={Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: IVAPP, (VISIGRAPP 2017)},
year={2017},
pages={322-329},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0006255003220329},
isbn={978-989-758-228-8},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 12th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications - Volume 3: IVAPP, (VISIGRAPP 2017)
TI - Multisensory Analytics: Case of Visual-auditory Analysis of Scalar Fields
SN - 978-989-758-228-8
AU - Malikova E.
AU - Pilyugin V.
AU - Adzhiev V.
AU - Pasko G.
AU - Pasko A.
PY - 2017
SP - 322
EP - 329
DO - 10.5220/0006255003220329