Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

Brian Cleland; J. G. Wallace; RR Bond; Salla Muurais; Juha Pajula; Gorka Epelde; Mónica  Arrúec; Roberto Álvarez; Michaela Black; Maurice Mulvenna; Debbie Rankin; Paul Carlin

doi:10.1007/978-3-030-22660-2_13

Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

Brian Cleland, J. G. Wallace, RR Bond, Salla Muurais, Juha Pajula, Gorka Epelde, Mónica Arrúec, Roberto Álvarez, Michaela Black, Maurice Mulvenna, Debbie Rankin, Paul Carlin

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

9 Citations (Scopus)

315 Downloads (Pure)

Abstract

The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.

Original language	English
Title of host publication	Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings
Subtitle of host publication	Visual Information and Knowledge Management. HCII 2019
Editors	Sakae Yamamoto, Hirohiko Mori
Pages	194-207
Number of pages	14
Volume	11569
ISBN (Electronic)	978-3-030-22660-2
DOIs	https://doi.org/10.1007/978-3-030-22660-2_13
Publication status	Published (in print/issue) - 28 Jun 2019
Event	International Conference on Human-Computer Interaction - USA, Orlando, United States Duration: 26 Jul 2019 → 31 Jul 2019 Conference number: 21 http://2019.hci.international/

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11569 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	International Conference on Human-Computer Interaction
Abbreviated title	HCII
Country/Territory	United States
City	Orlando
Period	26/07/19 → 31/07/19
Internet address	http://2019.hci.international/

Keywords

Big data
Health
Usability
Policy-making
User-centred
Evaluation

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

Access to Document

10.1007/978-3-030-22660-2_13

Accepted versionAuthor Accepted Manuscript, 671 KB

Cite this

Cleland, B., Wallace, J. G., Bond, RR., Muurais, S., Pajula, J., Epelde, G., Arrúec, M., Álvarez, R., Black, M., Mulvenna, M., Rankin, D., & Carlin, P. (2019). Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. In S. Yamamoto, & H. Mori (Eds.), Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings: Visual Information and Knowledge Management. HCII 2019 (Vol. 11569, pp. 194-207). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11569 LNCS). https://doi.org/10.1007/978-3-030-22660-2_13

Cleland, Brian ; Wallace, J. G. ; Bond, RR et al. / Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings: Visual Information and Knowledge Management. HCII 2019. editor / Sakae Yamamoto ; Hirohiko Mori. Vol. 11569 2019. pp. 194-207 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{e1a836f6e1de4277a2122ba7901ea15b,

title = "Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making",

abstract = "The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users{\textquoteright} prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.",

keywords = "Big data, Health, Usability, Policy-making, User-centred, Evaluation",

author = "Brian Cleland and Wallace, {J. G.} and RR Bond and Salla Muurais and Juha Pajula and Gorka Epelde and M{\'o}nica Arr{\'u}ec and Roberto {\'A}lvarez and Michaela Black and Maurice Mulvenna and Debbie Rankin and Paul Carlin",

year = "2019",

month = jun,

day = "28",

doi = "10.1007/978-3-030-22660-2_13",

language = "English",

isbn = "978-3-030-22659-6",

volume = "11569",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "194--207",

editor = "Sakae Yamamoto and Hirohiko Mori",

booktitle = "Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings",

note = "International Conference on Human-Computer Interaction, HCII ; Conference date: 26-07-2019 Through 31-07-2019",

url = "http://2019.hci.international/",

}

Cleland, B, Wallace, JG , Bond, RR, Muurais, S, Pajula, J, Epelde, G, Arrúec, M, Álvarez, R, Black, M , Mulvenna, M , Rankin, D & Carlin, P 2019, Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. in S Yamamoto & H Mori (eds), Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings: Visual Information and Knowledge Management. HCII 2019. vol. 11569, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11569 LNCS, pp. 194-207, International Conference on Human-Computer Interaction, Orlando, United States, 26/07/19. https://doi.org/10.1007/978-3-030-22660-2_13

Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. / Cleland, Brian; Wallace, J. G.; Bond, RR et al.
Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings: Visual Information and Knowledge Management. HCII 2019. ed. / Sakae Yamamoto; Hirohiko Mori. Vol. 11569 2019. p. 194-207 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11569 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

AU - Cleland, Brian

AU - Wallace, J. G.

AU - Bond, RR

AU - Muurais, Salla

AU - Pajula, Juha

AU - Epelde, Gorka

AU - Arrúec, Mónica

AU - Álvarez, Roberto

AU - Black, Michaela

AU - Mulvenna, Maurice

AU - Rankin, Debbie

AU - Carlin, Paul

N1 - Conference code: 21

PY - 2019/6/28

Y1 - 2019/6/28

N2 - The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.

AB - The increasingly important role of big data in organisational decision-making brings with it significant challenges in terms of designing usable software interfaces. Specifically, such interfaces must allow users to explore, analyse, and visualise complex data from heterogeneous sources and derive insights to support management decisions. This paper describes a usability evaluation of the MIDAS Project, a big data platform for health policy-making, developed by an EU-funded Horizon 2020 project involving a number of international partners and pilot sites. We describe how a combination of heuristic and formative user-centred evaluation methods were employed, and give a summary of the key findings. We discuss key insights from the evaluation, including the importance of having diverse users, the role played by users’ prior expectations, and the logistical challenge of coordinating user testing across multiple sites. Finally, we explore the relative value of each of the evaluation methods, and outline how our approach to usability testing will evolve for future iterations of the MIDAS platform.

KW - Big data

KW - Health

KW - Usability

KW - Policy-making

KW - User-centred

KW - Evaluation

UR - http://www.scopus.com/inward/record.url?scp=85069809567&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-22660-2_13

DO - 10.1007/978-3-030-22660-2_13

M3 - Conference contribution

SN - 978-3-030-22659-6

VL - 11569

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 194

EP - 207

BT - Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings

A2 - Yamamoto, Sakae

A2 - Mori, Hirohiko

T2 - International Conference on Human-Computer Interaction

Y2 - 26 July 2019 through 31 July 2019

ER -

Cleland B, Wallace JG , Bond RR, Muurais S, Pajula J, Epelde G et al. Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making. In Yamamoto S, Mori H, editors, Human Interface and the Management of Information. Visual Information and Knowledge Management - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings: Visual Information and Knowledge Management. HCII 2019. Vol. 11569. 2019. p. 194-207. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-22660-2_13

Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

Abstract

Publication series

Conference

Keywords

UN SDGs

Access to Document

Other files and links

Fingerprint

Michaela Black

Debbie Rankin

Cite this

Usability Evaluation of a Co-created Big Data Analytics Platform for Health Policy-Making

Abstract

Publication series

Conference

Keywords

UN SDGs

Access to Document

Other files and links

Fingerprint

Profiles

Michaela Black

Debbie Rankin

Cite this