Premium
Language experience influences audiovisual speech integration in unimodal and bimodal bilingual infants
Author(s) -
Mercure Evelyne,
Kushnerenko Elena,
Goldberg Laura,
BowdenHowl Harriet,
Coulson Kimberley,
Johnson Mark H,
MacSweeney Mairéad
Publication year - 2019
Publication title -
developmental science
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.801
H-Index - 127
eISSN - 1467-7687
pISSN - 1363-755X
DOI - 10.1111/desc.12701
Subject(s) - psychology , articulation (sociology) , surprise , contrast (vision) , audiology , speech perception , novelty , developmental psychology , cognitive psychology , communication , perception , medicine , neuroscience , social psychology , artificial intelligence , politics , political science , computer science , law
Infants as young as 2 months can integrate audio and visual aspects of speech articulation. A shift of attention from the eyes towards the mouth of talking faces occurs around 6 months of age in monolingual infants. However, it is unknown whether this pattern of attention during audiovisual speech processing is influenced by speech and language experience in infancy. The present study investigated this question by analysing audiovisual speech processing in three groups of 4‐ to 8‐month‐old infants who differed in their language experience: monolinguals, unimodal bilinguals (infants exposed to two or more spoken languages) and bimodal bilinguals (hearing infants with Deaf mothers). Eye‐tracking was used to study patterns of face scanning while infants were viewing faces articulating syllables with congruent, incongruent and silent auditory tracks. Monolinguals and unimodal bilinguals increased their attention to the mouth of talking faces between 4 and 8 months, while bimodal bilinguals did not show any age difference in their scanning patterns. Moreover, older (6.6 to 8 months), but not younger, monolinguals (4 to 6.5 months) showed increased visual attention to the mouth of faces articulating audiovisually incongruent rather than congruent faces, indicating surprise or novelty. In contrast, no audiovisual congruency effect was found in unimodal or bimodal bilinguals. Results suggest that speech and language experience influences audiovisual integration in infancy. Specifically, reduced or more variable experience of audiovisual speech from the primary caregiver may lead to less sensitivity to the integration of audio and visual cues of speech articulation.