Classification of imagined spoken word-pairs using convolutional neural networks

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

499 Downloads (Pure)

Abstract

Imagined speech is gaining traction as a communicative paradigm for brain-computer-interfaces (BCI), as a growing body of research indicates the potential for decoding speech processes directly from the brain. The development of this type of direct-speech BCI has primarily considered feature extraction and machine learning approaches typical to BCI decoding. Here, we consider the potential of deep learning as a possible alternative to traditional BCI methodologies in relation to imagined speech EEG decoding. Two different convolutional neural networks (CNN) were trained on multiple imagined speech word-pairs, and their performance compared to a baseline linear discriminant analysis (LDA) classifier trained using filterbank common spatial patterns (FBCSP) features. Classifiers were trained using nested cross-validation to enable hyper-parameter optimization. Results obtained showed that the CNNs outperformed the FBCSP with average accuracies of 62.37% and 60.88% vs. 57.80% (p<0.005).
Original languageEnglish
Title of host publicationProceedings of the 8th Graz Brain Computer Interface Conference 2019
Subtitle of host publicationBridging Science and Application
EditorsGernot R Muller-Putz, Jonas C Ditz, Selina C Wriessnegger
PublisherVerlag der Technischen Universitat Graz
Pages338-343
Volume2019
ISBN (Print)978-3-85125-682-6
DOIs
Publication statusPublished (in print/issue) - 20 Sept 2019
EventThe 8th Graz BCI Conference, 2019 - Institute of Neural Engineering, Graz University of Technology, Graz, Austria
Duration: 16 Sept 201920 Sept 2023
https://www.tugraz.at/institute/ine/graz-bci-conferences/8th-graz-bci-conference-2019/

Publication series

NameProceedings of the 8th Graz Brain-Computer Interface Conference 2019
PublisherGraz University of Technology
ISSN (Print)2311-0422

Conference

ConferenceThe 8th Graz BCI Conference, 2019
Country/TerritoryAustria
CityGraz
Period16/09/1920/09/23
Internet address

Keywords

  • Electroencephalogram (EEG)
  • Imagined Speech
  • Convolutional Neural Network
  • Brain-Computer Interface

Fingerprint

Dive into the research topics of 'Classification of imagined spoken word-pairs using convolutional neural networks'. Together they form a unique fingerprint.

Cite this