Open AccessEvent-related potentials reveal early visual-tactile integration in the deaf
Author(s) -
Siyi Liu,
Aitao Lu,
Haiping Tian,
Yixi Cai,
Meifang Zhang,
Tianhua Song,
Guisheng Chen,
Dianning Qu
Publication year - 2022
Publication title -
psihologija
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.222
H-Index - 16
eISSN - 1451-9283
pISSN - 0048-5705
DOI - 10.2298/psi210407003l
Subject(s) - multisensory integration , psychology , perception , audiology , modality (human–computer interaction) , event related potential , tactile perception , cognitive psychology , visual perception , stimulus modality , communication , electroencephalography , neuroscience , computer science , artificial intelligence , medicine
This study examined visual-tactile perceptual integration in deaf and normal hearing individuals. Participants were presented with photos of faces or pictures of an oval in either a visual mode or a visual-tactile mode in a recognition learning task. Event-related potentials (ERPs) were recorded when participants recognized real faces and pictures of ovals in learning stage. Results from the parietal-occipital region showed that photos of faces accompanied with vibration elicited more positive-going ERP responses than photos of faces without vibration as indicated in the components of P1 and N170 in both deaf and hearing individuals. However, pictures of ovals accompanied with vibration produced more positive-going ERP responses than pictures of ovals without vibration in N170, which was only found in deaf individuals. A reversed pattern was shown in the temporal region indicating that real faces with vibration elicited less positive ERPs than photos of faces without vibration in both N170 and N300 for deaf, but such pattern did not appear in N170 and N300 for normal hearing. The results suggest that multisensory integration across the visual and tactile modality involves more fundamental perceptual regions than auditory regions. Moreover, auditory deprivation played an essential role at the perceptual encoding stage of the multisensory integration.