Evaluating User Engagement with a Reminiscence App Using Cross Comparative Analysis of User Event Logs and Qualitative Data

Research output: Contribution to journalArticle

Abstract

The aim of this study was to evaluate the usage of a reminiscence app by people living with dementia and their family carers, by comparing event log data generated from app usage alongside the qualitative experience of the process. A cross-comparative analysis of electronic event logging data with qualitative interview data was conducted. Electronic event logging data were obtained for 28 participating dyads (n = 56) and the interview sample comprised 14 people living with dementia and 16 family carers (n = 30). A thematic analysis framework was used in the analysis of interview transcripts and the identification of recurrent themes. The cross-comparison of electronic event log data and qualitative data revealed 25 out of 28 dyads regularly engaged with a reminiscence app, with the analysis of usage patterns revealing four clusters classifying different levels of user engagement. The cross-comparison of data revealed that the nature of the relationship was a significant factor in ongoing user engagement. The comparative analysis of the electronic event logs as "ground truth" in combination with the qualitative lived experience can provide a deeper understanding on the usage of a reminiscence app for those living with dementia and their family carers. This work not only shows the benefits of using automated event log data mining but also shows its clear limitations without using complementary qualitative data analysis. As such, this work also provides key insights into using mixed methods for evaluating human-computer interaction technologies.

LanguageEnglish
Pages543-551
Number of pages9
JournalCyberpsychology, Behavior, and Social Networking
Volume22
Issue number8
DOIs
Publication statusPublished - 12 Aug 2019

Fingerprint

reminiscence
Application programs
Caregivers
Dementia
Interviews
event
Data Mining
dementia
electronics
Human computer interaction
dyad
Technology
Data mining
interview
qualitative interview
experience
data analysis
interaction

Keywords

  • Dementia
  • Carers
  • Event logs
  • human-computer interaction
  • reminiscence
  • machine learning
  • digital phenotype
  • event logs
  • user logs
  • dementia
  • carers
  • human–computer interaction

Cite this

@article{fa8c024213e04abca4a6c9b60304e26b,
title = "Evaluating User Engagement with a Reminiscence App Using Cross Comparative Analysis of User Event Logs and Qualitative Data",
abstract = "The aim of this study was to evaluate the usage of a reminiscence app by people living with dementia and their family carers, by comparing event log data generated from app usage alongside the qualitative experience of the process. A cross-comparative analysis of electronic event logging data with qualitative interview data was conducted. Electronic event logging data were obtained for 28 participating dyads (n = 56) and the interview sample comprised 14 people living with dementia and 16 family carers (n = 30). A thematic analysis framework was used in the analysis of interview transcripts and the identification of recurrent themes. The cross-comparison of electronic event log data and qualitative data revealed 25 out of 28 dyads regularly engaged with a reminiscence app, with the analysis of usage patterns revealing four clusters classifying different levels of user engagement. The cross-comparison of data revealed that the nature of the relationship was a significant factor in ongoing user engagement. The comparative analysis of the electronic event logs as {"}ground truth{"} in combination with the qualitative lived experience can provide a deeper understanding on the usage of a reminiscence app for those living with dementia and their family carers. This work not only shows the benefits of using automated event log data mining but also shows its clear limitations without using complementary qualitative data analysis. As such, this work also provides key insights into using mixed methods for evaluating human-computer interaction technologies.",
keywords = "Dementia, Carers, Event logs, human-computer interaction, reminiscence, machine learning, digital phenotype, event logs, user logs, dementia, carers, human–computer interaction",
author = "{Mc Cauley}, Claire-Odile and RR Bond and A Ryan and Maurice Mulvenna and Liz/EA Laird and Aideen Gibson and B Bunting and Ferry, {Finola R} and Kevin Curran",
year = "2019",
month = "8",
day = "12",
doi = "10.1089/cyber.2019.0076",
language = "English",
volume = "22",
pages = "543--551",
journal = "Cyberpsychology, Behavior, and Social Networking",
issn = "2152-2715",
number = "8",

}

TY - JOUR

T1 - Evaluating User Engagement with a Reminiscence App Using Cross Comparative Analysis of User Event Logs and Qualitative Data

AU - Mc Cauley, Claire-Odile

AU - Bond, RR

AU - Ryan, A

AU - Mulvenna, Maurice

AU - Laird, Liz/EA

AU - Gibson, Aideen

AU - Bunting, B

AU - Ferry, Finola R

AU - Curran, Kevin

PY - 2019/8/12

Y1 - 2019/8/12

N2 - The aim of this study was to evaluate the usage of a reminiscence app by people living with dementia and their family carers, by comparing event log data generated from app usage alongside the qualitative experience of the process. A cross-comparative analysis of electronic event logging data with qualitative interview data was conducted. Electronic event logging data were obtained for 28 participating dyads (n = 56) and the interview sample comprised 14 people living with dementia and 16 family carers (n = 30). A thematic analysis framework was used in the analysis of interview transcripts and the identification of recurrent themes. The cross-comparison of electronic event log data and qualitative data revealed 25 out of 28 dyads regularly engaged with a reminiscence app, with the analysis of usage patterns revealing four clusters classifying different levels of user engagement. The cross-comparison of data revealed that the nature of the relationship was a significant factor in ongoing user engagement. The comparative analysis of the electronic event logs as "ground truth" in combination with the qualitative lived experience can provide a deeper understanding on the usage of a reminiscence app for those living with dementia and their family carers. This work not only shows the benefits of using automated event log data mining but also shows its clear limitations without using complementary qualitative data analysis. As such, this work also provides key insights into using mixed methods for evaluating human-computer interaction technologies.

AB - The aim of this study was to evaluate the usage of a reminiscence app by people living with dementia and their family carers, by comparing event log data generated from app usage alongside the qualitative experience of the process. A cross-comparative analysis of electronic event logging data with qualitative interview data was conducted. Electronic event logging data were obtained for 28 participating dyads (n = 56) and the interview sample comprised 14 people living with dementia and 16 family carers (n = 30). A thematic analysis framework was used in the analysis of interview transcripts and the identification of recurrent themes. The cross-comparison of electronic event log data and qualitative data revealed 25 out of 28 dyads regularly engaged with a reminiscence app, with the analysis of usage patterns revealing four clusters classifying different levels of user engagement. The cross-comparison of data revealed that the nature of the relationship was a significant factor in ongoing user engagement. The comparative analysis of the electronic event logs as "ground truth" in combination with the qualitative lived experience can provide a deeper understanding on the usage of a reminiscence app for those living with dementia and their family carers. This work not only shows the benefits of using automated event log data mining but also shows its clear limitations without using complementary qualitative data analysis. As such, this work also provides key insights into using mixed methods for evaluating human-computer interaction technologies.

KW - Dementia

KW - Carers

KW - Event logs

KW - human-computer interaction

KW - reminiscence

KW - machine learning

KW - digital phenotype

KW - event logs

KW - user logs

KW - dementia

KW - carers

KW - human–computer interaction

UR - http://www.scopus.com/inward/record.url?scp=85071282310&partnerID=8YFLogxK

U2 - 10.1089/cyber.2019.0076

DO - 10.1089/cyber.2019.0076

M3 - Article

VL - 22

SP - 543

EP - 551

JO - Cyberpsychology, Behavior, and Social Networking

T2 - Cyberpsychology, Behavior, and Social Networking

JF - Cyberpsychology, Behavior, and Social Networking

SN - 2152-2715

IS - 8

ER -