Abstract

This paper reports on a study that examines the value of several common usability testing protocols, methods and metrics when used to evaluate the usability of a new personalised reminiscence ‘app’. The app, called ‘InspireD’, is a bespoke app designed to support personalised reminiscence for people living with dementia. The study focused on determining the value of commonly used methods for evaluating usability of apps designed for use by people living with dementia and their caregivers. The study indicated that observation and recording of task completion rates and times produced the most reliable results. The think-aloud methodology was difficult for the people living with dementia and did not produce any reliable data. Thinking-aloud whilst doing a task may have been a distraction since it requires a higher cognitive load. The systematic usability scale score which is derived from a post-test instrument is not reliable, as it had no association with the task completion times.
LanguageEnglish
Title of host publicationUnknown Host Publication
EditorsH.M. Fardoun, Victor M. Penichet, D.M. Alghazzawi, Pedro Gamito
Pages25-31
Number of pages6
DOIs
Publication statusPublished - 13 Oct 2016
EventREHAB-2016 Workshop - Lisbon, Portugal
Duration: 13 Oct 2016 → …

Workshop

WorkshopREHAB-2016 Workshop
Period13/10/16 → …

Fingerprint

Application programs
Testing
Network protocols

Keywords

  • Usability protocols
  • usability
  • user experience
  • UX
  • human computer interaction
  • reminiscence
  • apps.

Cite this

@inproceedings{d4cfbc1358b642c1b82c5094f648bdac,
title = "Assessing Usability Testing for People Living with Dementia",
abstract = "This paper reports on a study that examines the value of several common usability testing protocols, methods and metrics when used to evaluate the usability of a new personalised reminiscence ‘app’. The app, called ‘InspireD’, is a bespoke app designed to support personalised reminiscence for people living with dementia. The study focused on determining the value of commonly used methods for evaluating usability of apps designed for use by people living with dementia and their caregivers. The study indicated that observation and recording of task completion rates and times produced the most reliable results. The think-aloud methodology was difficult for the people living with dementia and did not produce any reliable data. Thinking-aloud whilst doing a task may have been a distraction since it requires a higher cognitive load. The systematic usability scale score which is derived from a post-test instrument is not reliable, as it had no association with the task completion times.",
keywords = "Usability protocols, usability, user experience, UX, human computer interaction, reminiscence, apps.",
author = "Aideen Gibson and McCauley, {Claire Odile} and Maurice Mulvenna and Assumpta Ryan and Liz Laird and Kevin Curran and Brendan Bunting and Finola Ferry and Raymond Bond",
year = "2016",
month = "10",
day = "13",
doi = "10.1145/3051488.3051492",
language = "English",
isbn = "978-1-4503-4765-5",
pages = "25--31",
editor = "H.M. Fardoun and Penichet, {Victor M.} and D.M. Alghazzawi and Pedro Gamito",
booktitle = "Unknown Host Publication",

}

Gibson, A, McCauley, CO, Mulvenna, M, Ryan, A, Laird, L, Curran, K, Bunting, B, Ferry, F & Bond, R 2016, Assessing Usability Testing for People Living with Dementia. in HM Fardoun, VM Penichet, DM Alghazzawi & P Gamito (eds), Unknown Host Publication. pp. 25-31, REHAB-2016 Workshop, 13/10/16. https://doi.org/10.1145/3051488.3051492

Assessing Usability Testing for People Living with Dementia. / Gibson, Aideen; McCauley, Claire Odile; Mulvenna, Maurice; Ryan, Assumpta; Laird, Liz; Curran, Kevin; Bunting, Brendan; Ferry, Finola; Bond, Raymond.

Unknown Host Publication. ed. / H.M. Fardoun; Victor M. Penichet; D.M. Alghazzawi; Pedro Gamito. 2016. p. 25-31.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Assessing Usability Testing for People Living with Dementia

AU - Gibson, Aideen

AU - McCauley, Claire Odile

AU - Mulvenna, Maurice

AU - Ryan, Assumpta

AU - Laird, Liz

AU - Curran, Kevin

AU - Bunting, Brendan

AU - Ferry, Finola

AU - Bond, Raymond

PY - 2016/10/13

Y1 - 2016/10/13

N2 - This paper reports on a study that examines the value of several common usability testing protocols, methods and metrics when used to evaluate the usability of a new personalised reminiscence ‘app’. The app, called ‘InspireD’, is a bespoke app designed to support personalised reminiscence for people living with dementia. The study focused on determining the value of commonly used methods for evaluating usability of apps designed for use by people living with dementia and their caregivers. The study indicated that observation and recording of task completion rates and times produced the most reliable results. The think-aloud methodology was difficult for the people living with dementia and did not produce any reliable data. Thinking-aloud whilst doing a task may have been a distraction since it requires a higher cognitive load. The systematic usability scale score which is derived from a post-test instrument is not reliable, as it had no association with the task completion times.

AB - This paper reports on a study that examines the value of several common usability testing protocols, methods and metrics when used to evaluate the usability of a new personalised reminiscence ‘app’. The app, called ‘InspireD’, is a bespoke app designed to support personalised reminiscence for people living with dementia. The study focused on determining the value of commonly used methods for evaluating usability of apps designed for use by people living with dementia and their caregivers. The study indicated that observation and recording of task completion rates and times produced the most reliable results. The think-aloud methodology was difficult for the people living with dementia and did not produce any reliable data. Thinking-aloud whilst doing a task may have been a distraction since it requires a higher cognitive load. The systematic usability scale score which is derived from a post-test instrument is not reliable, as it had no association with the task completion times.

KW - Usability protocols

KW - usability

KW - user experience

KW - UX

KW - human computer interaction

KW - reminiscence

KW - apps.

U2 - 10.1145/3051488.3051492

DO - 10.1145/3051488.3051492

M3 - Conference contribution

SN - 978-1-4503-4765-5

SP - 25

EP - 31

BT - Unknown Host Publication

A2 - Fardoun, H.M.

A2 - Penichet, Victor M.

A2 - Alghazzawi, D.M.

A2 - Gamito, Pedro

ER -

Gibson A, McCauley CO, Mulvenna M, Ryan A, Laird L, Curran K et al. Assessing Usability Testing for People Living with Dementia. In Fardoun HM, Penichet VM, Alghazzawi DM, Gamito P, editors, Unknown Host Publication. 2016. p. 25-31 https://doi.org/10.1145/3051488.3051492