
Imagined Speech Detection Using Multi-Receptive CNN for Asynchronous BCI Communication and Neurorehabilitation
Author(s) -
Byung-Kwan Ko,
Seo-Hyun Lee,
Seong-Whan Lee
Publication year - 2025
Publication title -
ieee transactions on neural systems and rehabilitation engineering
Language(s) - English
Resource type - Magazines
SCImago Journal Rank - 1.093
H-Index - 140
eISSN - 1558-0210
pISSN - 1534-4320
DOI - 10.1109/tnsre.2025.3592312
Subject(s) - bioengineering , computing and processing , robotics and control systems , signal processing and analysis , communication, networking and broadcast technologies
Imagined speech-based brain-computer interface (BCI) facilitates brain signal-driven intuitive communication which holds great promise as an effective speech rehabilitation tool, enabling real-time, hands-free interaction for individuals with speech and motor impairments. While speech-based assistant systems rely on wake-word detection (e.g., “Hey Siri”), BCI-based communication system must capture imagined onset from EEG signals to turn on the ‘brain switch’ to further convey user’s imagined command. Nevertheless, the absence of reliable ground truth for the endogenous paradigm adds to the complexity to train the model to capture exact onset from continuous EEG. To address these issues, we introduce a multi-receptive field convolutional neural network, designed to capture speech and idle states based on behaviorally-aligned EEG features. We propose a voice-based ground truth alignment method with voting strategy that aims to synchronize imagined speech with overt speech onset and offset, providing a structured approach for capturing speech events in asynchronous BCI systems. Furthermore, spectral and phonological analyses revealed that beta and alpha bands, as well as syllable count, appear to influence speech state discriminability. Evaluations on imagined and overt speech tasks, including pseudo-online experiments, demonstrate the potential to enhance asynchronous BCI systems, supporting real-time communication for both healthy and impaired individuals.
Accelerating Research
Robert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom
Address
John Eccles HouseRobert Robinson Avenue,
Oxford Science Park, Oxford
OX4 4GP, United Kingdom