How Usable Are Usability Tests? Examining the Suitability of Standard Usability Testing Methods for the Assessment of Apps for People Living with Dementia

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

The potential for technology to support memory or enhance cognition for people living with dementia is currently an area of significant interest. The use of digital systems to facilitate reminiscing has been shown to be beneficial for people living with dementia. This paper reports on a study that examines the value of several common usability testing protocols, methods and metrics when used to evaluate the usability of a new personalised reminiscence ‘app’ called ‘InspireD’. InspireD is a bespoke app designed to support personalised reminiscence for people living with dementia. The app was co-created and designed with input from people living with dementia and their caregivers. The research question was ‘are standard usability protocols appropriate to assess the usability of apps for individuals living with dementia?’ The study aimed to determine on determining the appropriateness of methods commonly used to evaluate usability: concurrent think-aloud protocol; video recording and audio recording; metrics such as task completion rates; task completion times; single ease questions before and after task completion; and the systematic usability scale scores. Seven couples comprising a person with dementia with their primary caregiver evaluated the perceived usefulness and the level of user acceptance of the InspireD app. The study indicated that observation and recording of task completion rates and times produced the most reliable results, while the think-aloud methodology was difficult for the people living with dementia and did not produce any reliable data. Thinking-aloud whilst doing a task was perhaps a distraction since it requires a higher cognitive load. The systematic usability scale score which is derived from a post-test instrument is not reliable, as it had no association with the task completion times.
Original languageEnglish
Title of host publicationNew Technologies to Improve Patient Rehabilitation
Subtitle of host publication4th Workshop, REHAB 2016, Revised Selected Papers
EditorsHabib M Fardoun, Ahlam A M Hassan, M Elena de la Guía
PublisherSpringer
Chapter10
Pages126-143
Number of pages18
ISBN (Electronic)978-3-030-16785-1
ISBN (Print)978-3-030-16784-4
DOIs
Publication statusPublished - 28 Mar 2019
EventREHAB 2016: 4th Workshop on ICTs for Improving Patients' Rehabilitation Research Techniques - Universidade Lusófona de Humanidades e Tecnologias, Lisbon, Portugal
Duration: 13 Oct 201614 Oct 2016
http://www.rehab-workshop.org/2016/

Publication series

NameCommunications in Computer and Information Science
Volume1002
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Workshop

WorkshopREHAB 2016
Abbreviated titleREHAB
CountryPortugal
CityLisbon
Period13/10/1614/10/16
Internet address

Keywords

  • Usability protocols
  • Usability
  • User experience
  • UX
  • Human Computer Interaction (HCI)
  • User studies
  • Evaluation
  • Reminiscence
  • Apps
  • Assistive Technology
  • Human computer interaction
  • Assistive technology

Fingerprint Dive into the research topics of 'How Usable Are Usability Tests? Examining the Suitability of Standard Usability Testing Methods for the Assessment of Apps for People Living with Dementia'. Together they form a unique fingerprint.

  • Cite this

    Gibson, A., McCauley, C-O., Mulvenna, M., Ryan, A., Laird, L., Curran, K., ... Bond, RR. (2019). How Usable Are Usability Tests? Examining the Suitability of Standard Usability Testing Methods for the Assessment of Apps for People Living with Dementia. In H. M. Fardoun, A. A. M. Hassan, & M. E. de la Guía (Eds.), New Technologies to Improve Patient Rehabilitation: 4th Workshop, REHAB 2016, Revised Selected Papers (pp. 126-143). (Communications in Computer and Information Science; Vol. 1002). Springer. https://doi.org/10.1007/978-3-030-16785-1_10