Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

Brian Cleland, J. G. Wallace, RR Bond, Salla Muurais, Juha Pajula, Gorka Epelde, Mónica Arrúec, Roberto Álvarez, Michaela Black, Maurice Mulvenna, Debbie Rankin, Paul Carlin

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.
LanguageEnglish
Title of host publicationHuman Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings
Subtitle of host publicationVisual Information and Knowledge Management. HCII 2019
EditorsSakae Yamamoto, Hirohiko Mori
Pages194-207
Number of pages14
Volume11569
ISBN (Electronic)978-3-030-22660-2
DOIs
Publication statusPublished - 28 Jun 2019
EventInternational Conference on Human-Computer Interaction - USA, Orlando, United States
Duration: 26 Jul 201931 Jul 2019
Conference number: 21
http://2019.hci.international/

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11569 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceInternational Conference on Human-Computer Interaction
Abbreviated titleHCII
CountryUnited States
CityOrlando
Period26/07/1931/07/19
Internet address

Fingerprint

Usability Evaluation
Health
Testing
Evaluation Method
Decision making
Usability Testing
Multiple Testing
Horizon
Decision Making
Policy
Big data
Heuristics
Iteration
Software
Evaluation

Keywords

  • Big data
  • Health
  • Usability
  • Policy-making
  • User-centred
  • Evaluation

Cite this

Cleland, B., Wallace, J. G., Bond, RR., Muurais, S., Pajula, J., Epelde, G., ... Carlin, P. (2019). Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. In S. Yamamoto, & H. Mori (Eds.), Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings: Visual Information and Knowledge Management. HCII 2019 (Vol. 11569, pp. 194-207). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11569 LNCS). https://doi.org/10.1007/978-3-030-22660-2_13
Cleland, Brian ; Wallace, J. G. ; Bond, RR ; Muurais, Salla ; Pajula, Juha ; Epelde, Gorka ; Arrúec, Mónica ; Álvarez, Roberto ; Black, Michaela ; Mulvenna, Maurice ; Rankin, Debbie ; Carlin, Paul. / Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings: Visual Information and Knowledge Management. HCII 2019. editor / Sakae Yamamoto ; Hirohiko Mori. Vol. 11569 2019. pp. 194-207 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{e1a836f6e1de4277a2122ba7901ea15b,
title = "Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making",
abstract = "The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.",
keywords = "Big data, Health, Usability, Policy-making, User-centred, Evaluation",
author = "Brian Cleland and Wallace, {J. G.} and RR Bond and Salla Muurais and Juha Pajula and Gorka Epelde and M{\'o}nica Arr{\'u}ec and Roberto {\'A}lvarez and Michaela Black and Maurice Mulvenna and Debbie Rankin and Paul Carlin",
note = "Maurice Mulvenna changed the template so the uploaded manuscript date changed. The manuscript was originally uploaded by Raymond Bond when he created the output in July 2019",
year = "2019",
month = "6",
day = "28",
doi = "10.1007/978-3-030-22660-2_13",
language = "English",
isbn = "978-3-030-22659-6",
volume = "11569",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "194--207",
editor = "Sakae Yamamoto and Hirohiko Mori",
booktitle = "Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings",

}

Cleland, B, Wallace, JG, Bond, RR, Muurais, S, Pajula, J, Epelde, G, Arrúec, M, Álvarez, R, Black, M, Mulvenna, M, Rankin, D & Carlin, P 2019, Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. in S Yamamoto & H Mori (eds), Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings: Visual Information and Knowledge Management. HCII 2019. vol. 11569, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11569 LNCS, pp. 194-207, International Conference on Human-Computer Interaction, Orlando, United States, 26/07/19. https://doi.org/10.1007/978-3-030-22660-2_13

Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. / Cleland, Brian; Wallace, J. G.; Bond, RR; Muurais, Salla; Pajula, Juha; Epelde, Gorka; Arrúec, Mónica ; Álvarez, Roberto; Black, Michaela; Mulvenna, Maurice; Rankin, Debbie; Carlin, Paul.

Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings: Visual Information and Knowledge Management. HCII 2019. ed. / Sakae Yamamoto; Hirohiko Mori. Vol. 11569 2019. p. 194-207 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11569 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

AU - Cleland, Brian

AU - Wallace, J. G.

AU - Bond, RR

AU - Muurais, Salla

AU - Pajula, Juha

AU - Epelde, Gorka

AU - Arrúec, Mónica

AU - Álvarez, Roberto

AU - Black, Michaela

AU - Mulvenna, Maurice

AU - Rankin, Debbie

AU - Carlin, Paul

N1 - Maurice Mulvenna changed the template so the uploaded manuscript date changed. The manuscript was originally uploaded by Raymond Bond when he created the output in July 2019

PY - 2019/6/28

Y1 - 2019/6/28

N2 - The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.

AB - The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.

KW - Big data

KW - Health

KW - Usability

KW - Policy-making

KW - User-centred

KW - Evaluation

UR - http://www.scopus.com/inward/record.url?scp=85069809567&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-22660-2_13

DO - 10.1007/978-3-030-22660-2_13

M3 - Conference contribution

SN - 978-3-030-22659-6

VL - 11569

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 194

EP - 207

BT - Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings

A2 - Yamamoto, Sakae

A2 - Mori, Hirohiko

ER -

Cleland B, Wallace JG, Bond RR, Muurais S, Pajula J, Epelde G et al. Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. In Yamamoto S, Mori H, editors, Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings: Visual Information and Knowledge Management. HCII 2019. Vol. 11569. 2019. p. 194-207. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-22660-2_13