A Metric to Quantify if a Software Application Meets the User’s Expectation for Completing a Representative Task

Raymond Bond, Eelco Van Dam, Peter Van Dam, Dewar Finlay, Daniel Guldenring

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

A usability test was conducted to evaluate medical software (ECGSim). A total of 112 tasks were recorded (14 users each attempted 8 tasks). We wanted to evaluate two metrics that could be used to determine if the software meets the user’s expectation in carrying out a representative task. Each user answered two questions before completing a task, (Q1) how difficult do you expect this task to be out of 1-10? (where 10=most difficult) and (Q2) how long do you expect to complete this task? After attempting the task, the user was then asked to rate how difficult the task was. Thus two metrics were calculated for each user task, (Metric 1) Δ between the user’s expected task-completion time and actual task-completion time (derived from time-stamps via a screencast) and (Metric 2) Δ between pre-task difficulty rating and post-task difficulty rating. A paired t-test (p
LanguageEnglish
Title of host publicationUnknown Host Publication
Number of pages1
Publication statusPublished - 23 Oct 2015
EventIrish Human Computer Interaction - Dublin
Duration: 23 Oct 2015 → …

Conference

ConferenceIrish Human Computer Interaction
Period23/10/15 → …

Fingerprint

Application programs

Keywords

  • Usability
  • Human Computer Interaction
  • UX

Cite this

@inproceedings{9cf828beb6e1435ebf7bb3b3bc966da1,
title = "A Metric to Quantify if a Software Application Meets the User’s Expectation for Completing a Representative Task",
abstract = "A usability test was conducted to evaluate medical software (ECGSim). A total of 112 tasks were recorded (14 users each attempted 8 tasks). We wanted to evaluate two metrics that could be used to determine if the software meets the user’s expectation in carrying out a representative task. Each user answered two questions before completing a task, (Q1) how difficult do you expect this task to be out of 1-10? (where 10=most difficult) and (Q2) how long do you expect to complete this task? After attempting the task, the user was then asked to rate how difficult the task was. Thus two metrics were calculated for each user task, (Metric 1) Δ between the user’s expected task-completion time and actual task-completion time (derived from time-stamps via a screencast) and (Metric 2) Δ between pre-task difficulty rating and post-task difficulty rating. A paired t-test (p",
keywords = "Usability, Human Computer Interaction, UX",
author = "Raymond Bond and {Van Dam}, Eelco and {Van Dam}, Peter and Dewar Finlay and Daniel Guldenring",
year = "2015",
month = "10",
day = "23",
language = "English",
booktitle = "Unknown Host Publication",

}

Bond, R, Van Dam, E, Van Dam, P, Finlay, D & Guldenring, D 2015, A Metric to Quantify if a Software Application Meets the User’s Expectation for Completing a Representative Task. in Unknown Host Publication. Irish Human Computer Interaction, 23/10/15.

A Metric to Quantify if a Software Application Meets the User’s Expectation for Completing a Representative Task. / Bond, Raymond; Van Dam, Eelco; Van Dam, Peter; Finlay, Dewar; Guldenring, Daniel.

Unknown Host Publication. 2015.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - A Metric to Quantify if a Software Application Meets the User’s Expectation for Completing a Representative Task

AU - Bond, Raymond

AU - Van Dam, Eelco

AU - Van Dam, Peter

AU - Finlay, Dewar

AU - Guldenring, Daniel

PY - 2015/10/23

Y1 - 2015/10/23

N2 - A usability test was conducted to evaluate medical software (ECGSim). A total of 112 tasks were recorded (14 users each attempted 8 tasks). We wanted to evaluate two metrics that could be used to determine if the software meets the user’s expectation in carrying out a representative task. Each user answered two questions before completing a task, (Q1) how difficult do you expect this task to be out of 1-10? (where 10=most difficult) and (Q2) how long do you expect to complete this task? After attempting the task, the user was then asked to rate how difficult the task was. Thus two metrics were calculated for each user task, (Metric 1) Δ between the user’s expected task-completion time and actual task-completion time (derived from time-stamps via a screencast) and (Metric 2) Δ between pre-task difficulty rating and post-task difficulty rating. A paired t-test (p

AB - A usability test was conducted to evaluate medical software (ECGSim). A total of 112 tasks were recorded (14 users each attempted 8 tasks). We wanted to evaluate two metrics that could be used to determine if the software meets the user’s expectation in carrying out a representative task. Each user answered two questions before completing a task, (Q1) how difficult do you expect this task to be out of 1-10? (where 10=most difficult) and (Q2) how long do you expect to complete this task? After attempting the task, the user was then asked to rate how difficult the task was. Thus two metrics were calculated for each user task, (Metric 1) Δ between the user’s expected task-completion time and actual task-completion time (derived from time-stamps via a screencast) and (Metric 2) Δ between pre-task difficulty rating and post-task difficulty rating. A paired t-test (p

KW - Usability

KW - Human Computer Interaction

KW - UX

M3 - Conference contribution

BT - Unknown Host Publication

ER -