Speed of rapid serial visual presentation of pictures, numbers and words affects event-related potential-based detection accuracy

Stephanie Lees, P McCullagh, Phillippa Payne, Damien Coyle, Fabien Lotte, Liam Maguire

Research output: Contribution to journalArticle

Abstract

Rapid serial visual presentation (RSVP) based brain-computer interfaces (BCIs) can detect target images among a continuous stream of rapidly presented images, by classifying a viewer’s event related potentials (ERPs) associated with the target and non-targets images. Whilst the majority of RSVP-BCI studies to date have concentrated on the identification of a single type of image, namely pictures, here we study the capability of RSVP-BCI to detect three different target image types: pictures, numbers and words. The impact of presentation duration (speed) i.e., 100-200ms (5-10Hz), 200-300ms (3.3-5Hz) or 300-400ms (2.5-3.3Hz), is also investigated. 2-way repeated measure ANOVA on accuracies of detecting targets from non-target stimuli (ratio 1:9) measured via area under the receiver operator characteristics curve (AUC) for N=15 subjects revealed a significant effect of factor Stimulus-Type (pictures, numbers, words) (F (2,28) = 7.243, p = 0.003) and for Stimulus-Duration (F (2,28) = 5.591, p = 0.011). Furthermore, there is an interaction between stimulus type and duration: F (4,56) = 4.419, p = 0.004). The results indicate that when designing RSVP-BCI paradigms, the content of the images and the rate at which images are presented impact on the accuracy of detection and hence these parameters are key experimental variables in protocol design and applications, which apply RSVP for multimodal image datasets.
LanguageEnglish
Pages113-122
Number of pages9
JournalIEEE Transactions on Neural Systems and Rehabilitation Engineering
Volume28
Issue number1
Early online date10 Jan 2020
DOIs
Publication statusE-pub ahead of print - 10 Jan 2020

Fingerprint

Brain-Computer Interfaces
Brain computer interface
Evoked Potentials
Analysis of variance (ANOVA)
Area Under Curve
Analysis of Variance

Keywords

  • Rapid Serial Visual Presentation
  • Brain-Computer Interface
  • BCI
  • Event Related Potentials
  • Electroencephalography
  • EEG

Cite this

@article{711c44b5589d4e74be4c58596504874e,
title = "Speed of rapid serial visual presentation of pictures, numbers and words affects event-related potential-based detection accuracy",
abstract = "Rapid serial visual presentation (RSVP) based brain-computer interfaces (BCIs) can detect target images among a continuous stream of rapidly presented images, by classifying a viewer’s event related potentials (ERPs) associated with the target and non-targets images. Whilst the majority of RSVP-BCI studies to date have concentrated on the identification of a single type of image, namely pictures, here we study the capability of RSVP-BCI to detect three different target image types: pictures, numbers and words. The impact of presentation duration (speed) i.e., 100-200ms (5-10Hz), 200-300ms (3.3-5Hz) or 300-400ms (2.5-3.3Hz), is also investigated. 2-way repeated measure ANOVA on accuracies of detecting targets from non-target stimuli (ratio 1:9) measured via area under the receiver operator characteristics curve (AUC) for N=15 subjects revealed a significant effect of factor Stimulus-Type (pictures, numbers, words) (F (2,28) = 7.243, p = 0.003) and for Stimulus-Duration (F (2,28) = 5.591, p = 0.011). Furthermore, there is an interaction between stimulus type and duration: F (4,56) = 4.419, p = 0.004). The results indicate that when designing RSVP-BCI paradigms, the content of the images and the rate at which images are presented impact on the accuracy of detection and hence these parameters are key experimental variables in protocol design and applications, which apply RSVP for multimodal image datasets.",
keywords = "Rapid Serial Visual Presentation, Brain-Computer Interface, BCI, Event Related Potentials, Electroencephalography, EEG",
author = "Stephanie Lees and P McCullagh and Phillippa Payne and Damien Coyle and Fabien Lotte and Liam Maguire",
year = "2020",
month = "1",
day = "10",
doi = "10.1109/TNSRE.2019.2953975",
language = "English",
volume = "28",
pages = "113--122",
journal = "IEEE Transactions on Neural Systems and Rehabilitation Engineering",
issn = "1534-4320",
number = "1",

}

TY - JOUR

T1 - Speed of rapid serial visual presentation of pictures, numbers and words affects event-related potential-based detection accuracy

AU - Lees, Stephanie

AU - McCullagh, P

AU - Payne, Phillippa

AU - Coyle, Damien

AU - Lotte, Fabien

AU - Maguire, Liam

PY - 2020/1/10

Y1 - 2020/1/10

N2 - Rapid serial visual presentation (RSVP) based brain-computer interfaces (BCIs) can detect target images among a continuous stream of rapidly presented images, by classifying a viewer’s event related potentials (ERPs) associated with the target and non-targets images. Whilst the majority of RSVP-BCI studies to date have concentrated on the identification of a single type of image, namely pictures, here we study the capability of RSVP-BCI to detect three different target image types: pictures, numbers and words. The impact of presentation duration (speed) i.e., 100-200ms (5-10Hz), 200-300ms (3.3-5Hz) or 300-400ms (2.5-3.3Hz), is also investigated. 2-way repeated measure ANOVA on accuracies of detecting targets from non-target stimuli (ratio 1:9) measured via area under the receiver operator characteristics curve (AUC) for N=15 subjects revealed a significant effect of factor Stimulus-Type (pictures, numbers, words) (F (2,28) = 7.243, p = 0.003) and for Stimulus-Duration (F (2,28) = 5.591, p = 0.011). Furthermore, there is an interaction between stimulus type and duration: F (4,56) = 4.419, p = 0.004). The results indicate that when designing RSVP-BCI paradigms, the content of the images and the rate at which images are presented impact on the accuracy of detection and hence these parameters are key experimental variables in protocol design and applications, which apply RSVP for multimodal image datasets.

AB - Rapid serial visual presentation (RSVP) based brain-computer interfaces (BCIs) can detect target images among a continuous stream of rapidly presented images, by classifying a viewer’s event related potentials (ERPs) associated with the target and non-targets images. Whilst the majority of RSVP-BCI studies to date have concentrated on the identification of a single type of image, namely pictures, here we study the capability of RSVP-BCI to detect three different target image types: pictures, numbers and words. The impact of presentation duration (speed) i.e., 100-200ms (5-10Hz), 200-300ms (3.3-5Hz) or 300-400ms (2.5-3.3Hz), is also investigated. 2-way repeated measure ANOVA on accuracies of detecting targets from non-target stimuli (ratio 1:9) measured via area under the receiver operator characteristics curve (AUC) for N=15 subjects revealed a significant effect of factor Stimulus-Type (pictures, numbers, words) (F (2,28) = 7.243, p = 0.003) and for Stimulus-Duration (F (2,28) = 5.591, p = 0.011). Furthermore, there is an interaction between stimulus type and duration: F (4,56) = 4.419, p = 0.004). The results indicate that when designing RSVP-BCI paradigms, the content of the images and the rate at which images are presented impact on the accuracy of detection and hence these parameters are key experimental variables in protocol design and applications, which apply RSVP for multimodal image datasets.

KW - Rapid Serial Visual Presentation

KW - Brain-Computer Interface

KW - BCI

KW - Event Related Potentials

KW - Electroencephalography

KW - EEG

U2 - 10.1109/TNSRE.2019.2953975

DO - 10.1109/TNSRE.2019.2953975

M3 - Article

VL - 28

SP - 113

EP - 122

JO - IEEE Transactions on Neural Systems and Rehabilitation Engineering

T2 - IEEE Transactions on Neural Systems and Rehabilitation Engineering

JF - IEEE Transactions on Neural Systems and Rehabilitation Engineering

SN - 1534-4320

IS - 1

ER -