Assessing the Usability of a Chatbot for Mental Health Care

Gillian Cameron, David Cameron, Gavin Megaw, RR Bond, Maurice Mulvenna, Siobhan O'Neill, C Armour, Michael McTear

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The aim of this paper is to assess the usability of a chatbot for mental health care within a social enterprise. Chatbots are becoming more prevalent in our daily lives, as we can now use them to book flights, manage savings, and check the weather. Chatbots are increasingly being used in mental health care, with the emergence of “virtual therapists”. In this study, the usability of a chatbot named iHelpr has been assessed. iHelpr has been developed to provide guided self-assessment, and tips for the following areas: stress, anxiety, depression, sleep, and self esteem. This study used a questionnaire developed by Chatbottest, and the System Usability Scale to assess the usability of iHelpr. The participants in this study enjoyed interacting with the chatbot, and found it easy to use. However, the study highlighted areas that need major improvements, such as Error Management and Intelligence. A list of recommendations has been developed to improve the usability of the iHelpr chatbot.
LanguageEnglish
Title of host publicationInternet Science
Subtitle of host publicationINSCI 2018 International Workshops, St. Petersburg, Russia, October 24–26, 2018, Revised Selected Papers
EditorsAsbjørn Følstad, Harry Halpin, Heiko Niedermayer, Svetlana S. Bodrunova, Anna Smoliarova, Olessia Koltsova, Polina Kolozaridi, Leonid Yuldashev
Place of PublicationSpringer Nature Switzerland AG 2019
PublisherSpringer Verlag
Chapter4
Pages121-132
Number of pages11
Volume11551
ISBN (Electronic)978-3-030-17705-8
ISBN (Print)978-3-030-17704-1
Publication statusPublished - 17 Apr 2019
Event5th International Conference on Internet Science, INSCI 2018 - St. Petersburg, Russian Federation
Duration: 24 Oct 201826 Oct 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11551 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference5th International Conference on Internet Science, INSCI 2018
CountryRussian Federation
CitySt. Petersburg
Period24/10/1826/10/18

Fingerprint

Mental Health
Delivery of Health Care
Weather
Intelligence
Self Concept
Sleep
Anxiety
Depression
Surveys and Questionnaires
Self-Assessment

Keywords

  • Chatbot usability
  • Chatbots
  • Human Computer Interaction
  • Mental healthcare
  • Microsoft Bot Framework
  • System Usability Scale
  • User experience

Cite this

Cameron, G., Cameron, D., Megaw, G., Bond, RR., Mulvenna, M., O'Neill, S., ... McTear, M. (2019). Assessing the Usability of a Chatbot for Mental Health Care. In A. Følstad, H. Halpin, H. Niedermayer, S. S. Bodrunova, A. Smoliarova, O. Koltsova, P. Kolozaridi, ... L. Yuldashev (Eds.), Internet Science: INSCI 2018 International Workshops, St. Petersburg, Russia, October 24–26, 2018, Revised Selected Papers (Vol. 11551, pp. 121-132). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11551 LNCS). Springer Nature Switzerland AG 2019: Springer Verlag.
Cameron, Gillian ; Cameron, David ; Megaw, Gavin ; Bond, RR ; Mulvenna, Maurice ; O'Neill, Siobhan ; Armour, C ; McTear, Michael. / Assessing the Usability of a Chatbot for Mental Health Care. Internet Science: INSCI 2018 International Workshops, St. Petersburg, Russia, October 24–26, 2018, Revised Selected Papers. editor / Asbjørn Følstad ; Harry Halpin ; Heiko Niedermayer ; Svetlana S. Bodrunova ; Anna Smoliarova ; Olessia Koltsova ; Polina Kolozaridi ; Leonid Yuldashev. Vol. 11551 Springer Nature Switzerland AG 2019 : Springer Verlag, 2019. pp. 121-132 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{4e4b8c7eff184634a3f041e421984c2b,
title = "Assessing the Usability of a Chatbot for Mental Health Care",
abstract = "The aim of this paper is to assess the usability of a chatbot for mental health care within a social enterprise. Chatbots are becoming more prevalent in our daily lives, as we can now use them to book flights, manage savings, and check the weather. Chatbots are increasingly being used in mental health care, with the emergence of “virtual therapists”. In this study, the usability of a chatbot named iHelpr has been assessed. iHelpr has been developed to provide guided self-assessment, and tips for the following areas: stress, anxiety, depression, sleep, and self esteem. This study used a questionnaire developed by Chatbottest, and the System Usability Scale to assess the usability of iHelpr. The participants in this study enjoyed interacting with the chatbot, and found it easy to use. However, the study highlighted areas that need major improvements, such as Error Management and Intelligence. A list of recommendations has been developed to improve the usability of the iHelpr chatbot.",
keywords = "Chatbot usability, Chatbots, Human Computer Interaction, Mental healthcare, Microsoft Bot Framework, System Usability Scale, User experience",
author = "Gillian Cameron and David Cameron and Gavin Megaw and RR Bond and Maurice Mulvenna and Siobhan O'Neill and C Armour and Michael McTear",
year = "2019",
month = "4",
day = "17",
language = "English",
isbn = "978-3-030-17704-1",
volume = "11551",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "121--132",
editor = "Asbj{\o}rn F{\o}lstad and Harry Halpin and Heiko Niedermayer and Bodrunova, {Svetlana S.} and Anna Smoliarova and Olessia Koltsova and Polina Kolozaridi and Leonid Yuldashev",
booktitle = "Internet Science",
address = "Germany",

}

Cameron, G, Cameron, D, Megaw, G, Bond, RR, Mulvenna, M, O'Neill, S, Armour, C & McTear, M 2019, Assessing the Usability of a Chatbot for Mental Health Care. in A Følstad, H Halpin, H Niedermayer, SS Bodrunova, A Smoliarova, O Koltsova, P Kolozaridi & L Yuldashev (eds), Internet Science: INSCI 2018 International Workshops, St. Petersburg, Russia, October 24–26, 2018, Revised Selected Papers. vol. 11551, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11551 LNCS, Springer Verlag, Springer Nature Switzerland AG 2019, pp. 121-132, 5th International Conference on Internet Science, INSCI 2018, St. Petersburg, Russian Federation, 24/10/18.

Assessing the Usability of a Chatbot for Mental Health Care. / Cameron, Gillian; Cameron, David; Megaw, Gavin; Bond, RR; Mulvenna, Maurice; O'Neill, Siobhan; Armour, C; McTear, Michael.

Internet Science: INSCI 2018 International Workshops, St. Petersburg, Russia, October 24–26, 2018, Revised Selected Papers. ed. / Asbjørn Følstad; Harry Halpin; Heiko Niedermayer; Svetlana S. Bodrunova; Anna Smoliarova; Olessia Koltsova; Polina Kolozaridi; Leonid Yuldashev. Vol. 11551 Springer Nature Switzerland AG 2019 : Springer Verlag, 2019. p. 121-132 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11551 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Assessing the Usability of a Chatbot for Mental Health Care

AU - Cameron, Gillian

AU - Cameron, David

AU - Megaw, Gavin

AU - Bond, RR

AU - Mulvenna, Maurice

AU - O'Neill, Siobhan

AU - Armour, C

AU - McTear, Michael

PY - 2019/4/17

Y1 - 2019/4/17

N2 - The aim of this paper is to assess the usability of a chatbot for mental health care within a social enterprise. Chatbots are becoming more prevalent in our daily lives, as we can now use them to book flights, manage savings, and check the weather. Chatbots are increasingly being used in mental health care, with the emergence of “virtual therapists”. In this study, the usability of a chatbot named iHelpr has been assessed. iHelpr has been developed to provide guided self-assessment, and tips for the following areas: stress, anxiety, depression, sleep, and self esteem. This study used a questionnaire developed by Chatbottest, and the System Usability Scale to assess the usability of iHelpr. The participants in this study enjoyed interacting with the chatbot, and found it easy to use. However, the study highlighted areas that need major improvements, such as Error Management and Intelligence. A list of recommendations has been developed to improve the usability of the iHelpr chatbot.

AB - The aim of this paper is to assess the usability of a chatbot for mental health care within a social enterprise. Chatbots are becoming more prevalent in our daily lives, as we can now use them to book flights, manage savings, and check the weather. Chatbots are increasingly being used in mental health care, with the emergence of “virtual therapists”. In this study, the usability of a chatbot named iHelpr has been assessed. iHelpr has been developed to provide guided self-assessment, and tips for the following areas: stress, anxiety, depression, sleep, and self esteem. This study used a questionnaire developed by Chatbottest, and the System Usability Scale to assess the usability of iHelpr. The participants in this study enjoyed interacting with the chatbot, and found it easy to use. However, the study highlighted areas that need major improvements, such as Error Management and Intelligence. A list of recommendations has been developed to improve the usability of the iHelpr chatbot.

KW - Chatbot usability

KW - Chatbots

KW - Human Computer Interaction

KW - Mental healthcare

KW - Microsoft Bot Framework

KW - System Usability Scale

KW - User experience

UR - http://www.scopus.com/inward/record.url?scp=85065299319&partnerID=8YFLogxK

UR - http://10.1007/978-3-030-17705-8_11

M3 - Conference contribution

SN - 978-3-030-17704-1

VL - 11551

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 121

EP - 132

BT - Internet Science

A2 - Følstad, Asbjørn

A2 - Halpin, Harry

A2 - Niedermayer, Heiko

A2 - Bodrunova, Svetlana S.

A2 - Smoliarova, Anna

A2 - Koltsova, Olessia

A2 - Kolozaridi, Polina

A2 - Yuldashev, Leonid

PB - Springer Verlag

CY - Springer Nature Switzerland AG 2019

ER -

Cameron G, Cameron D, Megaw G, Bond RR, Mulvenna M, O'Neill S et al. Assessing the Usability of a Chatbot for Mental Health Care. In Følstad A, Halpin H, Niedermayer H, Bodrunova SS, Smoliarova A, Koltsova O, Kolozaridi P, Yuldashev L, editors, Internet Science: INSCI 2018 International Workshops, St. Petersburg, Russia, October 24–26, 2018, Revised Selected Papers. Vol. 11551. Springer Nature Switzerland AG 2019: Springer Verlag. 2019. p. 121-132. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).