Brain Computer Interfaces for inclusion

P. J. McCullagh, Melanie Ware, G Lightbody, Maurice Mulvenna, HG McAllister, CD Nugent

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

In this paper, we describe an intelligent graphical user interface (IGUI) and a User Application Interface (UAI) tailored to Brain Computer Interface (BCI) interaction, designed for people with severe communication needs. The IGUI has three components; a two way interface for communication with BCI2000 concerning user events and event handling; an interface to user applications concerning the passing of user commands and associated device identifiers, and the receiving of notification of device status; and an interface to an extensible mark-up language (xml) file containing menu content definitions. The interface has achieved control of domotic applications. The architecture however permits control of more complex 'smart' environments and could be extended further for entertainment by interacting with media devices. Using components of the electroencephalogram (EEG) to mediate expression is also technically possible, but is much more speculative, and without proven efficacy. The IGUI-BCI approach described could potentially find wider use in the augmentation of the general population, to provide alternative computer interaction, an additional control channel and experimental leisure activities.
LanguageEnglish
Title of host publicationUnknown Host Publication
Place of PublicationNew York, NY, USA
Pages1-8
Number of pages8
DOIs
Publication statusPublished - 16 May 2010
EventProceedings of the 1st Augmented Human International Conference - Megève, France
Duration: 16 May 2010 → …

Conference

ConferenceProceedings of the 1st Augmented Human International Conference
Period16/05/10 → …

Fingerprint

Brain computer interface
Graphical user interfaces
Communication
Electroencephalography
Interfaces (computer)

Keywords

  • BCI

Cite this

McCullagh, P. J., Ware, M., Lightbody, G., Mulvenna, M., McAllister, HG., & Nugent, CD. (2010). Brain Computer Interfaces for inclusion. In Unknown Host Publication (pp. 1-8). New York, NY, USA. https://doi.org/10.1145/1785455.1785461
McCullagh, P. J. ; Ware, Melanie ; Lightbody, G ; Mulvenna, Maurice ; McAllister, HG ; Nugent, CD. / Brain Computer Interfaces for inclusion. Unknown Host Publication. New York, NY, USA, 2010. pp. 1-8
@inproceedings{046b0f48f9ed45f7a2421cfe09549398,
title = "Brain Computer Interfaces for inclusion",
abstract = "In this paper, we describe an intelligent graphical user interface (IGUI) and a User Application Interface (UAI) tailored to Brain Computer Interface (BCI) interaction, designed for people with severe communication needs. The IGUI has three components; a two way interface for communication with BCI2000 concerning user events and event handling; an interface to user applications concerning the passing of user commands and associated device identifiers, and the receiving of notification of device status; and an interface to an extensible mark-up language (xml) file containing menu content definitions. The interface has achieved control of domotic applications. The architecture however permits control of more complex 'smart' environments and could be extended further for entertainment by interacting with media devices. Using components of the electroencephalogram (EEG) to mediate expression is also technically possible, but is much more speculative, and without proven efficacy. The IGUI-BCI approach described could potentially find wider use in the augmentation of the general population, to provide alternative computer interaction, an additional control channel and experimental leisure activities.",
keywords = "BCI",
author = "McCullagh, {P. J.} and Melanie Ware and G Lightbody and Maurice Mulvenna and HG McAllister and CD Nugent",
note = "Reference text: 1 Wolpaw, J. R, McFarland D. J. Control of a two-dimensional movement signal by a non-invasive brain-computer interface in humans, Published by Proceedings of the National Academy of Sciences of the United States of America, December 21, 2004 vol. 101 no. 51 2 Laurentis, K. J., Arbel Y., Dubey R., Donchin E. Implementation of a P-300 brain computer interface for the control of a wheelchair mounted robotic arm system. Published by ASME in the Proceedings of the ASME 2008 Summer Bioengineering Conference (SBC2008), June 25--29, pp. 1--2 (2008). 3 Blanchard, Gilles, Blankertz, Benjamin, (2003) BCI Competition 2003---Data Set IIa: Spatial Patterns of Self-Controlled Brain Rhythm Modulations, Published by IEEE. 4 Millan J. R, 'Adaptive Brain Interfaces', Communications of the ACM, March 2003, Vol 46 No 3, pp. 75--80. 5 Valsan G, Grychtol B, Lakany H, Conway B. A, 'The Strathclyde Brain Computer Interface', IEEE 31st. Annual International Conference on Engineering in Medicine and Biology Society, Sept 2009, pp. 606--609. 6 Leeb R, Friedman D, M{\"u}ller-Putz G. R, Scherer R, Slater M, Pfurtscheller G, 'Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetrplegic', Journal of Computational Intelligence and Neuroscience, Vol 2007. 7 Blankertz B, Krauledat M, Dornhege G, Williamson J, Murray-Smith, M{\"u}ller K. R, 'A Note on Brain Actuated Spelling with the Berlin Brain-Computer Interface', Lecture Notes on Computer Science, 2007, Vol 4555, pp. 759--768, Heidelberg, Springer. 8 Felton E, Lewis N. L, Willis S. A, Radwin R. G, 'Neural Signal Nased Control of the Dasher Writing System', IEEE 3rd. International EMBS Conference on Neural Engineering, May 2007, pp. 366--370. 9 Bensch M, Karim A. A, Mellinger J, Hinterberger T, Tangermann M, Bogdan M, Rosenstiel W, Birbaumer N, 'Nessi: An EEG-Controlled Web Browser for Severely Paralyzed Patients', Journal of Computational Intelligence and Neuroscience, Vol 2007. 10 Piccini L, Parini S, Maggi L, Andreoni G, 'A Wearable Home BCI System: Preliminary Results with SSVEP Protocol', Proceedings of the IEEE 27th. Annual Conference Engineering in Medicine and Biology, 2005, pp. 5384--5387. 11 Teo E, Huang A, Lian Y, Guan C, Li Y, Zhang H, 'Media Communication Centre Using Brain Computer Interface', Proceedings of the IEEE 28th. Annual Conference Engineering in Medicine and Biology, 2006, pp. 2954--2957. 12 Bayliss J, 'Use of the Evoked Potential P3 Component for Control in a Virtual Appartment', IEEE Transactions on Neural Systems and Rehabilitation Engineering Vol 11, No 2, 2003, pp. 113--116. 13 Martinez P, Bakardjian H, Cichocki A, 'Fully Online Multicommand Brain-Computer Interface with Visual Neurofeedback Using SSVEP Paradigm', Journal of Computational Intelligence and Neuroscience, Vol 2007. 14 Berlin Brain-Computer Interface -- The HCI Communication Channel for Discovery', International Journal Human-Computer Studies, Vol 65, 2007 pp. 460--477. 15 Chan M, Est{\`e}ve D, Escriba C, Campo E, 'A Review of Smart Homes -- Present State and Future Challenges', Computer Methods and Programs in Biomedicine, Vol 91, 2008, pp. 55--81. 16 Poland, M. P, Nugent, C. D, Wang, H, Chen L, 'Smart Home Research: Projects and Issues', International Journal of Ambient Computing and Intelligence, Vol 1, No 4, 2009, pp. 32--45. 17 Progress in Brain/Neuronal Computer Interaction (BNCI), http://hmi.ewi.utwente.nl/future-bnci, accessed Jan 2010. 18 Durka P, Kus R, Zygierewicz J, Milanowski P and Garcia G, 'High-frequency SSVEP responses parametrized by multichannel matching pursuit', Frontiers in Neuroinformatics. Conference Abstract: 2nd INCF Congress of Neuroinformatics. 2009. 19 Garcia G, Ibanez D, Mihajlovic V, Chestakov D, 'Detection of High Frequency Steady State Visual Evoked Potentials for Brain-Computer Interfaces', 17th European Signal Processing Conference, 2009. 20 Mason S. G, Moore Jackson M. M, Birch G. E, 'A General Framework for Characterizing Studies of Brain Interface Technology', Annuals of Biomedical Engineering, Vol 33, No 11, November February 2005, pp. 1653--1670. 21 Schalk G, McFarland D, Hinterberger T, Birbaumer N, Wolpaw J. R, 'BCI2000: A General-Purpose Brain-Computer Interface (BCI) System', IEEE Transactions on Biomedical Engineering Vol 51, No 6, June 2004, pp. 1034--1043. 22 Gao X, Xu D, Cheng M, Gao S, 'A BCI-Based Environmental Controller for the Motion-Disabled', IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol 11, No 2 June 2003, pp. 137--140. 23 Parini S, Maggi L, Turconi A Robust and Self-Paced BCI System Based on a Four Class SSVEP Paradigm: Algorithms and Protocols for a High-Transfer-Rate Direct Brain Communication', Journal of Computational Intelligence and Neuroscience, 2009. 24 ENABLE project (2008). Can Technology help people with Dementia? Retrieved July 7, from http://www.enableproject.org/ 25 Kidd, C. D., Orr, R. J., Abowd, G. D., Atkeson, C. G., Essa, I. A., MacIntyre, B., Mynatt, E., Starner, T. E., Newstetter, W. (1999). The Aware home: a living laboratory for ubiquitous computing research, Proceedings of 2nd International workshop on cooperative buildings Integrating Information, Organization, and Architecture, 191--198. 26 Kolger, M. 2006. Free Development Environment for bus coupling units of the European Installation Bus. Available at http://www.auto.tuwien.ac.at/~mkoegler/eib/sdkdoc-0.0.2.pdf. [Accessed on 21.07.09] 27 SICARE SENIOR PILOT, 2008. Available at: http://www.reflectivepractices.co.uk/cms/index.php?option=displaypage&Itemid=50&op=page&SubMenu= [Accessed on 21.07.09]. 28 Miranda, E. R. and Brouse, A. (2005a). Interfacing the Brain Directly with Musical Systems: On developing systems for making music with brain signals, Leonardo, 38(4):331--336 29 Lucier, A (1965). Music for the solo performer, http://www.emfinstitute.emf.org/exhibits/luciersolo.html last accessed July 2007. 30 Rosenboom, D. (2003). Propositional Music from Extended Musical Interface with the Human Nervous System, Annals of the New York Academy of Sciences 999, pp 263. 31 Brouse, A., Filatriau, J.-J., Gaitanis, K., Lehembre, R., Macq, B., Miranda, E. and Zenon, A. (2006). {"}An instrument of sound and visual creation driven by biological signals{"}. Proceedings of ENTERFACE06, Dubrovnik (Croatia). (Not peer-reviewed report.) 32 Filatriau, J. J., Lehembre, R., Macq, B., Brouse, A. and Miranda, E. R. (2007). From EEG signals to a world of sound and visual textures. (Submitted to ICASSP07 conference). 33 Drake music project (2007), http://www.drakemusicproject.org/, last accessed July 2007 34 Arslan, B., Brouse, A., Castet, J., Lehembre, R., Simon, C., Filatriau, JJ and Noirhomme, Q. (2006). A Real Time Music Synthesis Environment Driven with Biological Signals, IEEE International Conference on Acoustics, Speech and Signal Processing, 2006. ICASSP 2006 Proceedings, vol. 2.",
year = "2010",
month = "5",
day = "16",
doi = "10.1145/1785455.1785461",
language = "English",
isbn = "978-1-60558-825-4",
pages = "1--8",
booktitle = "Unknown Host Publication",

}

McCullagh, PJ, Ware, M, Lightbody, G, Mulvenna, M, McAllister, HG & Nugent, CD 2010, Brain Computer Interfaces for inclusion. in Unknown Host Publication. New York, NY, USA, pp. 1-8, Proceedings of the 1st Augmented Human International Conference, 16/05/10. https://doi.org/10.1145/1785455.1785461

Brain Computer Interfaces for inclusion. / McCullagh, P. J.; Ware, Melanie; Lightbody, G; Mulvenna, Maurice; McAllister, HG; Nugent, CD.

Unknown Host Publication. New York, NY, USA, 2010. p. 1-8.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Brain Computer Interfaces for inclusion

AU - McCullagh, P. J.

AU - Ware, Melanie

AU - Lightbody, G

AU - Mulvenna, Maurice

AU - McAllister, HG

AU - Nugent, CD

N1 - Reference text: 1 Wolpaw, J. R, McFarland D. J. Control of a two-dimensional movement signal by a non-invasive brain-computer interface in humans, Published by Proceedings of the National Academy of Sciences of the United States of America, December 21, 2004 vol. 101 no. 51 2 Laurentis, K. J., Arbel Y., Dubey R., Donchin E. Implementation of a P-300 brain computer interface for the control of a wheelchair mounted robotic arm system. Published by ASME in the Proceedings of the ASME 2008 Summer Bioengineering Conference (SBC2008), June 25--29, pp. 1--2 (2008). 3 Blanchard, Gilles, Blankertz, Benjamin, (2003) BCI Competition 2003---Data Set IIa: Spatial Patterns of Self-Controlled Brain Rhythm Modulations, Published by IEEE. 4 Millan J. R, 'Adaptive Brain Interfaces', Communications of the ACM, March 2003, Vol 46 No 3, pp. 75--80. 5 Valsan G, Grychtol B, Lakany H, Conway B. A, 'The Strathclyde Brain Computer Interface', IEEE 31st. Annual International Conference on Engineering in Medicine and Biology Society, Sept 2009, pp. 606--609. 6 Leeb R, Friedman D, Müller-Putz G. R, Scherer R, Slater M, Pfurtscheller G, 'Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetrplegic', Journal of Computational Intelligence and Neuroscience, Vol 2007. 7 Blankertz B, Krauledat M, Dornhege G, Williamson J, Murray-Smith, Müller K. R, 'A Note on Brain Actuated Spelling with the Berlin Brain-Computer Interface', Lecture Notes on Computer Science, 2007, Vol 4555, pp. 759--768, Heidelberg, Springer. 8 Felton E, Lewis N. L, Willis S. A, Radwin R. G, 'Neural Signal Nased Control of the Dasher Writing System', IEEE 3rd. International EMBS Conference on Neural Engineering, May 2007, pp. 366--370. 9 Bensch M, Karim A. A, Mellinger J, Hinterberger T, Tangermann M, Bogdan M, Rosenstiel W, Birbaumer N, 'Nessi: An EEG-Controlled Web Browser for Severely Paralyzed Patients', Journal of Computational Intelligence and Neuroscience, Vol 2007. 10 Piccini L, Parini S, Maggi L, Andreoni G, 'A Wearable Home BCI System: Preliminary Results with SSVEP Protocol', Proceedings of the IEEE 27th. Annual Conference Engineering in Medicine and Biology, 2005, pp. 5384--5387. 11 Teo E, Huang A, Lian Y, Guan C, Li Y, Zhang H, 'Media Communication Centre Using Brain Computer Interface', Proceedings of the IEEE 28th. Annual Conference Engineering in Medicine and Biology, 2006, pp. 2954--2957. 12 Bayliss J, 'Use of the Evoked Potential P3 Component for Control in a Virtual Appartment', IEEE Transactions on Neural Systems and Rehabilitation Engineering Vol 11, No 2, 2003, pp. 113--116. 13 Martinez P, Bakardjian H, Cichocki A, 'Fully Online Multicommand Brain-Computer Interface with Visual Neurofeedback Using SSVEP Paradigm', Journal of Computational Intelligence and Neuroscience, Vol 2007. 14 Berlin Brain-Computer Interface -- The HCI Communication Channel for Discovery', International Journal Human-Computer Studies, Vol 65, 2007 pp. 460--477. 15 Chan M, Estève D, Escriba C, Campo E, 'A Review of Smart Homes -- Present State and Future Challenges', Computer Methods and Programs in Biomedicine, Vol 91, 2008, pp. 55--81. 16 Poland, M. P, Nugent, C. D, Wang, H, Chen L, 'Smart Home Research: Projects and Issues', International Journal of Ambient Computing and Intelligence, Vol 1, No 4, 2009, pp. 32--45. 17 Progress in Brain/Neuronal Computer Interaction (BNCI), http://hmi.ewi.utwente.nl/future-bnci, accessed Jan 2010. 18 Durka P, Kus R, Zygierewicz J, Milanowski P and Garcia G, 'High-frequency SSVEP responses parametrized by multichannel matching pursuit', Frontiers in Neuroinformatics. Conference Abstract: 2nd INCF Congress of Neuroinformatics. 2009. 19 Garcia G, Ibanez D, Mihajlovic V, Chestakov D, 'Detection of High Frequency Steady State Visual Evoked Potentials for Brain-Computer Interfaces', 17th European Signal Processing Conference, 2009. 20 Mason S. G, Moore Jackson M. M, Birch G. E, 'A General Framework for Characterizing Studies of Brain Interface Technology', Annuals of Biomedical Engineering, Vol 33, No 11, November February 2005, pp. 1653--1670. 21 Schalk G, McFarland D, Hinterberger T, Birbaumer N, Wolpaw J. R, 'BCI2000: A General-Purpose Brain-Computer Interface (BCI) System', IEEE Transactions on Biomedical Engineering Vol 51, No 6, June 2004, pp. 1034--1043. 22 Gao X, Xu D, Cheng M, Gao S, 'A BCI-Based Environmental Controller for the Motion-Disabled', IEEE Transactions on Neural Systems and Rehabilitation Engineering, Vol 11, No 2 June 2003, pp. 137--140. 23 Parini S, Maggi L, Turconi A Robust and Self-Paced BCI System Based on a Four Class SSVEP Paradigm: Algorithms and Protocols for a High-Transfer-Rate Direct Brain Communication', Journal of Computational Intelligence and Neuroscience, 2009. 24 ENABLE project (2008). Can Technology help people with Dementia? Retrieved July 7, from http://www.enableproject.org/ 25 Kidd, C. D., Orr, R. J., Abowd, G. D., Atkeson, C. G., Essa, I. A., MacIntyre, B., Mynatt, E., Starner, T. E., Newstetter, W. (1999). The Aware home: a living laboratory for ubiquitous computing research, Proceedings of 2nd International workshop on cooperative buildings Integrating Information, Organization, and Architecture, 191--198. 26 Kolger, M. 2006. Free Development Environment for bus coupling units of the European Installation Bus. Available at http://www.auto.tuwien.ac.at/~mkoegler/eib/sdkdoc-0.0.2.pdf. [Accessed on 21.07.09] 27 SICARE SENIOR PILOT, 2008. Available at: http://www.reflectivepractices.co.uk/cms/index.php?option=displaypage&Itemid=50&op=page&SubMenu= [Accessed on 21.07.09]. 28 Miranda, E. R. and Brouse, A. (2005a). Interfacing the Brain Directly with Musical Systems: On developing systems for making music with brain signals, Leonardo, 38(4):331--336 29 Lucier, A (1965). Music for the solo performer, http://www.emfinstitute.emf.org/exhibits/luciersolo.html last accessed July 2007. 30 Rosenboom, D. (2003). Propositional Music from Extended Musical Interface with the Human Nervous System, Annals of the New York Academy of Sciences 999, pp 263. 31 Brouse, A., Filatriau, J.-J., Gaitanis, K., Lehembre, R., Macq, B., Miranda, E. and Zenon, A. (2006). "An instrument of sound and visual creation driven by biological signals". Proceedings of ENTERFACE06, Dubrovnik (Croatia). (Not peer-reviewed report.) 32 Filatriau, J. J., Lehembre, R., Macq, B., Brouse, A. and Miranda, E. R. (2007). From EEG signals to a world of sound and visual textures. (Submitted to ICASSP07 conference). 33 Drake music project (2007), http://www.drakemusicproject.org/, last accessed July 2007 34 Arslan, B., Brouse, A., Castet, J., Lehembre, R., Simon, C., Filatriau, JJ and Noirhomme, Q. (2006). A Real Time Music Synthesis Environment Driven with Biological Signals, IEEE International Conference on Acoustics, Speech and Signal Processing, 2006. ICASSP 2006 Proceedings, vol. 2.

PY - 2010/5/16

Y1 - 2010/5/16

N2 - In this paper, we describe an intelligent graphical user interface (IGUI) and a User Application Interface (UAI) tailored to Brain Computer Interface (BCI) interaction, designed for people with severe communication needs. The IGUI has three components; a two way interface for communication with BCI2000 concerning user events and event handling; an interface to user applications concerning the passing of user commands and associated device identifiers, and the receiving of notification of device status; and an interface to an extensible mark-up language (xml) file containing menu content definitions. The interface has achieved control of domotic applications. The architecture however permits control of more complex 'smart' environments and could be extended further for entertainment by interacting with media devices. Using components of the electroencephalogram (EEG) to mediate expression is also technically possible, but is much more speculative, and without proven efficacy. The IGUI-BCI approach described could potentially find wider use in the augmentation of the general population, to provide alternative computer interaction, an additional control channel and experimental leisure activities.

AB - In this paper, we describe an intelligent graphical user interface (IGUI) and a User Application Interface (UAI) tailored to Brain Computer Interface (BCI) interaction, designed for people with severe communication needs. The IGUI has three components; a two way interface for communication with BCI2000 concerning user events and event handling; an interface to user applications concerning the passing of user commands and associated device identifiers, and the receiving of notification of device status; and an interface to an extensible mark-up language (xml) file containing menu content definitions. The interface has achieved control of domotic applications. The architecture however permits control of more complex 'smart' environments and could be extended further for entertainment by interacting with media devices. Using components of the electroencephalogram (EEG) to mediate expression is also technically possible, but is much more speculative, and without proven efficacy. The IGUI-BCI approach described could potentially find wider use in the augmentation of the general population, to provide alternative computer interaction, an additional control channel and experimental leisure activities.

KW - BCI

U2 - 10.1145/1785455.1785461

DO - 10.1145/1785455.1785461

M3 - Conference contribution

SN - 978-1-60558-825-4

SP - 1

EP - 8

BT - Unknown Host Publication

CY - New York, NY, USA

ER -

McCullagh PJ, Ware M, Lightbody G, Mulvenna M, McAllister HG, Nugent CD. Brain Computer Interfaces for inclusion. In Unknown Host Publication. New York, NY, USA. 2010. p. 1-8 https://doi.org/10.1145/1785455.1785461