Does Ventriloquism Aftereffect Transfer across Sound Frequencies? - A Theoretical Analysis via a Neural Network Model

Elisa Magosso, Filippo Cona, Cristiano Cuppini, Mauro Ursino

2013

Abstract

When an auditory stimulus and a visual stimulus are simultaneously presented in spatial disparity, the sound is perceived shifted toward the visual stimulus (ventriloquism effect). After adaptation to a ventriloquism situation, enduring sound shifts are observed in the absence of the visual stimulus (ventriloquism aftereffect). Experimental studies report discordant results as to aftereffect generalization across sound frequencies, varying from aftereffect staying confined to the sound frequency used during the adaptation, to aftereffect transferring across some octaves of frequency. Here, we present a model of visual-auditory interactions, able to simulate the ventriloquism effect and to reproduce – via Hebbian plasticity rules – the ventriloquism aftereffect. The model is suitable to investigate aftereffect generalization as the simulated auditory neurons code both for spatial and spectral properties of the auditory stimuli. The model provides a plausible hypothesis to interpret the discordant results in the literature, showing that different sound intensities may produce different extents of aftereffect generalization. Model mechanisms and hypotheses are discussed in relation to the neurophysiological and psychophysical literature.

Paper Citation

in Harvard Style

Magosso E., Cona F., Cuppini C. and Ursino M. (2013). Does Ventriloquism Aftereffect Transfer across Sound Frequencies? - A Theoretical Analysis via a Neural Network Model . In Proceedings of the 5th International Joint Conference on Computational Intelligence - Volume 1: NCTA, (IJCCI 2013) ISBN 978-989-8565-77-8, pages 360-369. DOI: 10.5220/0004551403600369

in Bibtex Style

@conference{ncta13,
author={Elisa Magosso and Filippo Cona and Cristiano Cuppini and Mauro Ursino},
title={Does Ventriloquism Aftereffect Transfer across Sound Frequencies? - A Theoretical Analysis via a Neural Network Model},
booktitle={Proceedings of the 5th International Joint Conference on Computational Intelligence - Volume 1: NCTA, (IJCCI 2013)},
year={2013},
pages={360-369},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0004551403600369},
isbn={978-989-8565-77-8},
}

in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Joint Conference on Computational Intelligence - Volume 1: NCTA, (IJCCI 2013)
TI - Does Ventriloquism Aftereffect Transfer across Sound Frequencies? - A Theoretical Analysis via a Neural Network Model
SN - 978-989-8565-77-8
AU - Magosso E.
AU - Cona F.
AU - Cuppini C.
AU - Ursino M.
PY - 2013
SP - 360
EP - 369
DO - 10.5220/0004551403600369