Open AccessA Novel Idea of Imagine & Real Speech Decoding Model Using Electrocardiogram to Enhance BCI
Author(s) -
Chowdhury S. Islam
Publication year - 2020
Publication title -
american journal of science and engineering
Language(s) - English
Resource type - Journals
eISSN - 2687-9581
pISSN - 2687-9530
DOI - 10.15864/ajse.1405
Subject(s) - computer science , speech recognition , speech production , decoding methods , articulation (sociology) , motor theory of speech perception , neurocomputational speech processing , manner of articulation , artificial intelligence , speech perception , psychology , perception , telecommunications , neuroscience , politics , political science , law
Many researchers have tried to decode talked and guessed speech instantly from brain signals towards the growth of a raw-speech BCI. This paper intends to feature extraction and decoding, using the electrocorticoscope (ECoG), the auditory and articulatory features of the motor cortex. Consonants were selected as auditory depictions, and both positions of articulation and manners of articulation were selected as articulatory depictions. The auditory and articulatory representations were decoded at different time lags concerning the speech onset to find optimal temporal decoding parameters. Moreover, this work explores the role of the temporal lobe during speech production directly from ECoG signals. Also, their temporal propagation before and after the speech onset was performed using classification and statistical tests. A novel decoding model using temporal lobe activity was developed to predict a spectral representation of the speech envelope during speech production. Deep learning was utilized in our analysis. This new knowledge may be used to enhance existing speech-based BCI systems, which will offer a more natural communication modality. Also, the work contributes to the field of speech neurophysiology by providing a better understanding of speech processes in the brain.