Poster
in
Affinity Workshop: LatinX in AI (LXAI) Workshop
Recognition of grammatical classes of imagined speech words using a convolutional neural network and brain signals
Denise Magdalena Alonso Vazquez · Tonatiuh Hernández-Del-Toro · Omar Mendoza-Montoya · Ricardo Caraza · Hector Martinez · Carlos Reyes-Garcia · Javier M. Antelis
Keywords: [ Speech decoding ] [ Convolutional neural network ] [ imagined speech ] [ electroencephalography ]
In this paper, we analyze in time domain the signals acquired with 32 electroencephalography (EEG) channels from 10 healthy participants obtained during the imagined speech task of words in Spanish. We performed a statistical test to determine the location in space and time of the differences produced by imagining words from two grammatical classes: decision adverbs and nouns. Based on the statistical test results and using the EEGNet convolutional neural network, we evaluated three different data window sizes for the classification of the two grammatical groups. In the larger window W1 (700ms), we obtained an accuracy of 60.1%, while in the smaller window W3 (200ms), the accuracy obtained was 69.5%. This work is a first approach for the decoding of imagined speech words that are intended to be implemented in a brain-machine interface focused on patients with amyotrophic lateral sclerosis.