Action Games, Motor Imagery, and Control Strategies: Toward a Multi-button Controller

Damien Coyle, Jacqueline Stow, Karl McCreadie, Chen Li, Jhonatan Garcia, Jacinta McElligott, Aine Carroll

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

Motor imagery is a skill that can be learned to maximize the accuracy of sensorimotor rhythm (SMR)-based brain-computer game interaction (BCGI). Strategies for learning to intentionally modulate sensorimotor cortex activity have been developed, using computer games as a training paradigm and gameplay characteristics to motivate and challenge players. These range from one-dimensional movement of a game object to single-button or multi-button BCGI controllers. This chapter overviews SMR-based BCGI focusing on a number of studies to illustrate the key concepts, principles, and methodologies. Examples drawn from the action genre, the most popular BCI game genre, with progressive difficulty and challenges, are presented, including a classic ball-basket game, a spaceship game involving asteroid avoidance, and a platform-based combat-fighter game. A focus is on elucidating the prospects and challenges for BCGI. Preliminary results from a proof-of-concept study of a BCGI multi-button controller referred to as the “CircleTime” controller are presented. The CircleTime controller offers the user the option of selecting between six separate buttons using just two motor imagery tasks. Results involving five able-bodied and seven physically impaired users are presented to provide evidence that the games are accessible even without motor control and the typical levels of control accuracy given the length of time played. The CircleTime controller is tested within combat-fighter game which requires higher cognitive processes to determine commands and select actions as well as completion of short-term and longer-term time-critical actions. The chapter covers basic SMR-based BCI signal processing and performance assessment, progressive learning across games, and camouflaging prolonged training.
LanguageEnglish
Title of host publicationHandbook of Digital Games and Entertainment Technologies
Place of PublicationSingapore
Pages1-34
DOIs
Publication statusPublished - 2015

Fingerprint

Computer games
Brain
Controllers
Asteroids
Signal processing

Keywords

  • Brain-computer interface
  • electroencephalography (EEG)
  • BCI
  • Sensorimotor
  • Games Controller Motor imagery
  • Action games
  • Game genre

Cite this

Coyle, D., Stow, J., McCreadie, K., Li, C., Garcia, J., McElligott, J., & Carroll, A. (2015). Action Games, Motor Imagery, and Control Strategies: Toward a Multi-button Controller. In Handbook of Digital Games and Entertainment Technologies (pp. 1-34). Singapore. https://doi.org/10.1007/978-981-4560-52-8_1-1
Coyle, Damien ; Stow, Jacqueline ; McCreadie, Karl ; Li, Chen ; Garcia, Jhonatan ; McElligott, Jacinta ; Carroll, Aine. / Action Games, Motor Imagery, and Control Strategies: Toward a Multi-button Controller. Handbook of Digital Games and Entertainment Technologies. Singapore, 2015. pp. 1-34
@inbook{1d990878a7be4a6f802fd430d3434d95,
title = "Action Games, Motor Imagery, and Control Strategies: Toward a Multi-button Controller",
abstract = "Motor imagery is a skill that can be learned to maximize the accuracy of sensorimotor rhythm (SMR)-based brain-computer game interaction (BCGI). Strategies for learning to intentionally modulate sensorimotor cortex activity have been developed, using computer games as a training paradigm and gameplay characteristics to motivate and challenge players. These range from one-dimensional movement of a game object to single-button or multi-button BCGI controllers. This chapter overviews SMR-based BCGI focusing on a number of studies to illustrate the key concepts, principles, and methodologies. Examples drawn from the action genre, the most popular BCI game genre, with progressive difficulty and challenges, are presented, including a classic ball-basket game, a spaceship game involving asteroid avoidance, and a platform-based combat-fighter game. A focus is on elucidating the prospects and challenges for BCGI. Preliminary results from a proof-of-concept study of a BCGI multi-button controller referred to as the “CircleTime” controller are presented. The CircleTime controller offers the user the option of selecting between six separate buttons using just two motor imagery tasks. Results involving five able-bodied and seven physically impaired users are presented to provide evidence that the games are accessible even without motor control and the typical levels of control accuracy given the length of time played. The CircleTime controller is tested within combat-fighter game which requires higher cognitive processes to determine commands and select actions as well as completion of short-term and longer-term time-critical actions. The chapter covers basic SMR-based BCI signal processing and performance assessment, progressive learning across games, and camouflaging prolonged training.",
keywords = "Brain-computer interface, electroencephalography (EEG), BCI, Sensorimotor, Games Controller Motor imagery, Action games, Game genre",
author = "Damien Coyle and Jacqueline Stow and Karl McCreadie and Chen Li and Jhonatan Garcia and Jacinta McElligott and Aine Carroll",
year = "2015",
doi = "10.1007/978-981-4560-52-8_1-1",
language = "English",
isbn = "978-981-4560-52-8",
pages = "1--34",
booktitle = "Handbook of Digital Games and Entertainment Technologies",

}

Coyle, D, Stow, J, McCreadie, K, Li, C, Garcia, J, McElligott, J & Carroll, A 2015, Action Games, Motor Imagery, and Control Strategies: Toward a Multi-button Controller. in Handbook of Digital Games and Entertainment Technologies. Singapore, pp. 1-34. https://doi.org/10.1007/978-981-4560-52-8_1-1

Action Games, Motor Imagery, and Control Strategies: Toward a Multi-button Controller. / Coyle, Damien; Stow, Jacqueline; McCreadie, Karl; Li, Chen; Garcia, Jhonatan; McElligott, Jacinta; Carroll, Aine.

Handbook of Digital Games and Entertainment Technologies. Singapore, 2015. p. 1-34.

Research output: Chapter in Book/Report/Conference proceedingChapter

TY - CHAP

T1 - Action Games, Motor Imagery, and Control Strategies: Toward a Multi-button Controller

AU - Coyle, Damien

AU - Stow, Jacqueline

AU - McCreadie, Karl

AU - Li, Chen

AU - Garcia, Jhonatan

AU - McElligott, Jacinta

AU - Carroll, Aine

PY - 2015

Y1 - 2015

N2 - Motor imagery is a skill that can be learned to maximize the accuracy of sensorimotor rhythm (SMR)-based brain-computer game interaction (BCGI). Strategies for learning to intentionally modulate sensorimotor cortex activity have been developed, using computer games as a training paradigm and gameplay characteristics to motivate and challenge players. These range from one-dimensional movement of a game object to single-button or multi-button BCGI controllers. This chapter overviews SMR-based BCGI focusing on a number of studies to illustrate the key concepts, principles, and methodologies. Examples drawn from the action genre, the most popular BCI game genre, with progressive difficulty and challenges, are presented, including a classic ball-basket game, a spaceship game involving asteroid avoidance, and a platform-based combat-fighter game. A focus is on elucidating the prospects and challenges for BCGI. Preliminary results from a proof-of-concept study of a BCGI multi-button controller referred to as the “CircleTime” controller are presented. The CircleTime controller offers the user the option of selecting between six separate buttons using just two motor imagery tasks. Results involving five able-bodied and seven physically impaired users are presented to provide evidence that the games are accessible even without motor control and the typical levels of control accuracy given the length of time played. The CircleTime controller is tested within combat-fighter game which requires higher cognitive processes to determine commands and select actions as well as completion of short-term and longer-term time-critical actions. The chapter covers basic SMR-based BCI signal processing and performance assessment, progressive learning across games, and camouflaging prolonged training.

AB - Motor imagery is a skill that can be learned to maximize the accuracy of sensorimotor rhythm (SMR)-based brain-computer game interaction (BCGI). Strategies for learning to intentionally modulate sensorimotor cortex activity have been developed, using computer games as a training paradigm and gameplay characteristics to motivate and challenge players. These range from one-dimensional movement of a game object to single-button or multi-button BCGI controllers. This chapter overviews SMR-based BCGI focusing on a number of studies to illustrate the key concepts, principles, and methodologies. Examples drawn from the action genre, the most popular BCI game genre, with progressive difficulty and challenges, are presented, including a classic ball-basket game, a spaceship game involving asteroid avoidance, and a platform-based combat-fighter game. A focus is on elucidating the prospects and challenges for BCGI. Preliminary results from a proof-of-concept study of a BCGI multi-button controller referred to as the “CircleTime” controller are presented. The CircleTime controller offers the user the option of selecting between six separate buttons using just two motor imagery tasks. Results involving five able-bodied and seven physically impaired users are presented to provide evidence that the games are accessible even without motor control and the typical levels of control accuracy given the length of time played. The CircleTime controller is tested within combat-fighter game which requires higher cognitive processes to determine commands and select actions as well as completion of short-term and longer-term time-critical actions. The chapter covers basic SMR-based BCI signal processing and performance assessment, progressive learning across games, and camouflaging prolonged training.

KW - Brain-computer interface

KW - electroencephalography (EEG)

KW - BCI

KW - Sensorimotor

KW - Games Controller Motor imagery

KW - Action games

KW - Game genre

UR - http://isrc.ulster.ac.uk/dcoyle/contact.html

UR - http://isrc.ulster.ac.uk/dcoyle/contact.html

U2 - 10.1007/978-981-4560-52-8_1-1

DO - 10.1007/978-981-4560-52-8_1-1

M3 - Chapter

SN - 978-981-4560-52-8

SP - 1

EP - 34

BT - Handbook of Digital Games and Entertainment Technologies

CY - Singapore

ER -

Coyle D, Stow J, McCreadie K, Li C, Garcia J, McElligott J et al. Action Games, Motor Imagery, and Control Strategies: Toward a Multi-button Controller. In Handbook of Digital Games and Entertainment Technologies. Singapore. 2015. p. 1-34 https://doi.org/10.1007/978-981-4560-52-8_1-1