Multimodal Feedback in Assisting a Wearable Brain-Computer Interface Based on Motor Imagery

Pasquale Arpaia, Damien Coyle, Francesco Donnarumma, Antonio Esposito, Angela Natalizio, Marco Parvis, Marisa Pesola, Ersilia Vallefuoco

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

A multimodal sensory feedback was exploited in the present study to improve the detection of neurological phenomena associated with motor imagery. At this aim, visual and haptic feedback were simultaneously delivered to the user of a brain-computer interface. The motor imagery-based brain-computer interface was built by using a wearable and portable electroencephalograph with only eight dry electrodes, a haptic suit, and a purposely implemented virtual reality application. Preliminary experiments were carried out with six subjects participating in five sessions on different days. The subjects were randomly divided into “control group” and “neurofeedback group”. The former performed pure motor imagery without receiving any feedback, while the latter received multimodal feedback as a response to their imaginative act. Results of a cross validation showed that at most 61% of classification accuracy was achieved in performing the pure motor imagination. On the contrary, subjects of the “neurofeedback group” achieved up to 82% mean accuracy, with a peak of 91% in one of the sessions. However, no improvement in pure motor imagery was observed, either when practicing with pure motor imagery or with feedback.
Original languageEnglish
Title of host publication2022 IEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)
PublisherIEEE
Pages691-696
ISBN (Electronic)978-1-6654-8574-6, 978-1-6654-8573-9
ISBN (Print)978-1-6654-8575-3
DOIs
Publication statusPublished (in print/issue) - 5 Dec 2022
EventIEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE) - Rome, Italy
Duration: 26 Oct 202228 Oct 2022

Conference

ConferenceIEEE International Conference on Metrology for Extended Reality, Artificial Intelligence and Neural Engineering (MetroXRAINE)
Abbreviated titleMetroXRAINE
Country/TerritoryItaly
CityRome
Period26/10/2228/10/22

Keywords

  • brain-computer interface
  • motor imagery
  • electroencephalography
  • extended reality
  • neurofeedback
  • wearability
  • dry electrodes

Cite this