Deep Learning Based Inter-subject Continuous Decoding of Motor Imagery for Practical Brain-Computer Interfaces

Sujit Roy, Anirban Chowdhury, Karl McCreadie, Girijesh Prasad

Research output: Contribution to journalArticlepeer-review

14 Citations (Scopus)
35 Downloads (Pure)


Inter-subject transfer learning is a long-standing problem in brain-computer interfaces (BCIs) and has not yet been fully realized due to high inter-subject variability in the brain signals related to motor imagery (MI). The recent success of deep learning-based algorithms in classifying different brain signals warrants further exploration to determine whether it is feasible for the inter-subject continuous decoding of MI signals to provide contingent neurofeedback which is important for neurorehabilitative BCI designs. In this paper, we have shown how a convolutional neural network (CNN) based deep learning framework can be used for inter-subject continuous decoding of MI related electroencephalographic (EEG) signals using the novel concept of Mega Blocks for adapting the network against inter-subject variabilities. These Mega Blocks have the capacity to repeat a specific architectural block several times such as one or more convolutional layers in a single Mega Block. The parameters of such Mega Blocks can be optimized using Bayesian hyperparameter optimization. The results, obtained on the publicly available BCI competition IV-2b dataset, yields an average inter-subject continuous decoding accuracy of 71.49% (κ = 0.42) and 70.84% (κ = 0.42) for two different training methods such as adaptive moment estimation (Adam) and stochastic gradient descent (SGDM), respectively, in 7 out of 9 subjects. Our results show for the first time that it is feasible to use CNN based architectures for inter-subject continuous decoding with a sufficient level of accuracy for developing calibration-free MI-BCIs for practical purposes. [Abstract copyright: Copyright © 2020 Roy, Chowdhury, McCreadie and Prasad.]
Original languageEnglish
Article number918
Pages (from-to)1-16
Number of pages16
JournalFrontiers in Neuroscience
Publication statusPublished (in print/issue) - 30 Sep 2020

Bibliographical note

Funding Information:
This work was supported in part by the Department of Science and Technology, India, and in part by the UK-India Education and Research Initiative (UKIERI)—Thematic Partnership Project Advancing MEG based Brain-computer Interface Supported Upper Limb Post-stroke Rehabilitation under Grant DST-UKIERI-2016-17-0128.

Publisher Copyright:
© Copyright © 2020 Roy, Chowdhury, McCreadie and Prasad.

Copyright 2020 Elsevier B.V., All rights reserved.


  • ADAM
  • SGDM
  • adaptive learning
  • brain-computer interface (BCI)
  • convolutional neural network (CNN)
  • deep learning
  • electroencephalography (EEG)
  • motor imagery


Dive into the research topics of 'Deep Learning Based Inter-subject Continuous Decoding of Motor Imagery for Practical Brain-Computer Interfaces'. Together they form a unique fingerprint.

Cite this