Classification of imagined spoken word-pairs using convolutional neural networks

Research output: Chapter in Book/Report/Conference proceedingConference contribution

103 Downloads (Pure)

Abstract

Imagined speech is gaining traction as a communicative paradigm for brain-computer-interfaces (BCI), as a growing body of research indicates the potential for decoding speech processes directly from the brain. The development of this type of direct-speech BCI has primarily considered feature extraction and machine learning approaches typical to BCI decoding. Here, we consider the potential of deep learning as a possible alternative to traditional BCI methodologies in relation to imagined speech EEG decoding. Two different convolutional neural networks (CNN) were trained on multiple imagined speech word-pairs, and their performance compared to a baseline linear discriminant analysis (LDA) classifier trained using filterbank common spatial patterns (FBCSP) features. Classifiers were trained using nested cross-validation to enable hyper-parameter optimization. Results obtained showed that the CNNs outperformed the FBCSP with average accuracies of 62.37% and 60.88% vs. 57.80% (p<0.005).
Original languageEnglish
Title of host publicationProceedings of the 8th Graz Brain Computer Interface Conference 2019
Subtitle of host publicationBridging Science and Application
EditorsGernot R Muller-Putz, Jonas C Ditz, Selina C Wriessnegger
PublisherVerlag der Technischen Universitat Graz
Pages338-343
Volume2019
ISBN (Print)978-3-85125-682-6
DOIs
Publication statusPublished - 20 Sep 2019
EventThe 8th Graz BCI Conference, 2019 - Institute of Neural Engineering, Graz University of Technology, Graz, Austria
Duration: 16 Sep 201920 Sep 2023
https://www.tugraz.at/institute/ine/graz-bci-conferences/8th-graz-bci-conference-2019/

Publication series

NameProceedings of the 8th Graz Brain-Computer Interface Conference 2019
PublisherGraz University of Technology
ISSN (Print)2311-0422

Conference

ConferenceThe 8th Graz BCI Conference, 2019
CountryAustria
CityGraz
Period16/09/1920/09/23
Internet address

Keywords

  • Electroencephalogram (EEG)
  • Imagined Speech
  • Convolutional Neural Network
  • Brain-Computer Interface

Fingerprint Dive into the research topics of 'Classification of imagined spoken word-pairs using convolutional neural networks'. Together they form a unique fingerprint.

  • Cite this

    Cooney, C., Korik, A., Raffaella, F., & Coyle, D. (2019). Classification of imagined spoken word-pairs using convolutional neural networks. In G. R. Muller-Putz, J. C. Ditz, & S. C. Wriessnegger (Eds.), Proceedings of the 8th Graz Brain Computer Interface Conference 2019: Bridging Science and Application (Vol. 2019, pp. 338-343). (Proceedings of the 8th Graz Brain-Computer Interface Conference 2019). Verlag der Technischen Universitat Graz. https://doi.org/10.3217/978-3-85125-682-6-62