Premium
Bimodal Speech Perception by Native and Nonnative Speakers of English: Factors Influencing the McGurk Effect
Author(s) -
Hardison Debra M.
Publication year - 1996
Publication title -
language learning
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.882
H-Index - 103
eISSN - 1467-9922
pISSN - 0023-8333
DOI - 10.1111/j.1467-1770.1996.tb00640.x
Subject(s) - psychology , perception , speech perception , first language , audiology , linguistics , cognitive psychology , medicine , philosophy , neuroscience
Two experiments explored factors affecting the influence of visual (lip‐read) information on auditory speech perception, the “McGurk effect”, in 120 advanced ESL learners of 4 L1s (Japanese, Korean, Spanish, and Malay) and 50 native speakers (NSs) of English. The audio and video speech signals of a female English speaker producing CV syllables with /p,f,w,r,t,k/ and// were combined on videotape. For nonnative speakers (NNSs), identification accuracy of /f/ and /r/ increased with matched visual cues. Visual nonlabials /t,k/ significantly influenced perception of auditory labials. For NSs, significant effects were noted only in noise. When stimuli involved only /p,t,k/, NSs and NNSs reported significant visual effects. Results demonstrate the influence of first language (L1) and linguistic experience on the relative information value of the cues, assumption of perceptual unity, and thus audiovisual integration. Implications for bimodal speech perception and second language instruction are discussed.