Premium
Reduced audiovisual integration in synesthesia – evidence from bimodal speech perception
Author(s) -
Sinke Christopher,
Neufeld Janina,
Zedler Markus,
Emrich Hinderk M.,
Bleich Stefan,
Münte Thomas F.,
Szycik Gregor R.
Publication year - 2014
Publication title -
journal of neuropsychology
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.85
H-Index - 37
eISSN - 1748-6653
pISSN - 1748-6645
DOI - 10.1111/jnp.12006
Subject(s) - synesthesia , psychology , multisensory integration , perception , illusion , crossmodal , cognitive psychology , speech perception , audiology , visual perception , sensory system , neuroscience , medicine
Recent research suggests synesthesia as a result of a hypersensitive multimodal binding mechanism. To address the question whether multimodal integration is altered in synesthetes in general, grapheme‐colour and auditory‐visual synesthetes were investigated using speech‐related stimulation in two behavioural experiments. First, we used the McGurk illusion to test the strength and number of illusory perceptions in synesthesia. In a second step, we analysed the gain in speech perception coming from seen articulatory movements under acoustically noisy conditions. We used disyllabic nouns as stimulation and varied signal‐to‐noise ratio of the auditory stream presented concurrently to a matching video of the speaker. We hypothesized that if synesthesia is due to a general hyperbinding mechanism this group of subjects should be more susceptible to McGurk illusions and profit more from the visual information during audiovisual speech perception. The results indicate that there are differences between synesthetes and controls concerning multisensory integration – but in the opposite direction as hypothesized. Synesthetes showed a reduced number of illusions and had a reduced gain in comprehension by viewing matching articulatory movements in comparison to control subjects. Our results indicate that rather than having a hypersensitive binding mechanism, synesthetes show weaker integration of vision and audition.