A Decision Support System and Rule-based Algorithm to Augment the Human Interpretation of the 12-lead Electrocardiogram

Andrew Cairns, Raymond Bond, Dewar Finlay, Daniel Guldenring, Fabio Badilini, Guido Libretti, Aaron Peace, Stephen Leslie

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

BackgroundThe 12-lead Electrocardiogram (ECG) has been used to detect cardiac abnormalities in the same format for more than 70 years. However, due to the complex nature of 12-lead ECG interpretation, there is a significant cognitive workload required from the interpreter. This complexity in ECG interpretation often leads to errors in diagnosis and subsequent treatment. We have previously reported on the development of an ECG interpretation support system designed to augment the human interpretation process. This computerised decision support system has been named ‘Interactive Progressive based Interpretation’ (IPI). In this study, a decision support algorithm was built into the IPI system to suggest potential diagnoses based on the interpreter’s annotations of the 12-lead ECG. We hypothesise semi-automatic interpretation using a digital assistant can be an optimal man-machine model for ECG interpretation.Objectives: To improve interpretation accuracy and reduce missed co-abnormalities.Methods: The Differential Diagnoses Algorithm (DDA) was developed using web technologies where diagnostic ECG criteria are defined in an open storage format, Javascript Object Notation (JSON), which is queried using a rule-based reasoning algorithm to suggest diagnoses. To test our hypothesis, a counterbalanced trial was designed where subjects interpreted ECGs using the conventional approach and using the IPI + DDA approach.ResultsA total of 375 interpretations were collected. The IPI + DDA approach was shown to improve diagnostic accuracy by 8.7% (although not statistically significant, p-value = 0.1852), the IPI + DDA suggested the correct interpretation more often than the human interpreter in 7/10 cases (varying statistical significance). Human interpretation accuracy increased to 70% when seven suggestions were generated.ConclusionAlthough results were not found to be statistically significant, we found; 1) our decision support tool increased the number of correct interpretations, 2) the DDA algorithm suggested the correct interpretation more often than humans, and 3) as many as 7 computerized diagnostic suggestions augmented human decision making in ECG interpretation. Statistical significance may be achieved by expanding sample size.
LanguageEnglish
Pages781-786
JournalJournal of Electrocardiology
Volume50
Issue number6
Early online date9 Aug 2017
DOIs
Publication statusE-pub ahead of print - 9 Aug 2017

Fingerprint

decision support system
abnormality
decision making

Keywords

  • ECG
  • Decision support
  • Rule based algorithms
  • CDSS
  • DSS. HCI

Cite this

Cairns, Andrew ; Bond, Raymond ; Finlay, Dewar ; Guldenring, Daniel ; Badilini, Fabio ; Libretti, Guido ; Peace, Aaron ; Leslie, Stephen. / A Decision Support System and Rule-based Algorithm to Augment the Human Interpretation of the 12-lead Electrocardiogram. In: Journal of Electrocardiology. 2017 ; Vol. 50, No. 6. pp. 781-786.
@article{8a761f1797e84fbdbd247d1006ebda17,
title = "A Decision Support System and Rule-based Algorithm to Augment the Human Interpretation of the 12-lead Electrocardiogram",
abstract = "BackgroundThe 12-lead Electrocardiogram (ECG) has been used to detect cardiac abnormalities in the same format for more than 70 years. However, due to the complex nature of 12-lead ECG interpretation, there is a significant cognitive workload required from the interpreter. This complexity in ECG interpretation often leads to errors in diagnosis and subsequent treatment. We have previously reported on the development of an ECG interpretation support system designed to augment the human interpretation process. This computerised decision support system has been named ‘Interactive Progressive based Interpretation’ (IPI). In this study, a decision support algorithm was built into the IPI system to suggest potential diagnoses based on the interpreter’s annotations of the 12-lead ECG. We hypothesise semi-automatic interpretation using a digital assistant can be an optimal man-machine model for ECG interpretation.Objectives: To improve interpretation accuracy and reduce missed co-abnormalities.Methods: The Differential Diagnoses Algorithm (DDA) was developed using web technologies where diagnostic ECG criteria are defined in an open storage format, Javascript Object Notation (JSON), which is queried using a rule-based reasoning algorithm to suggest diagnoses. To test our hypothesis, a counterbalanced trial was designed where subjects interpreted ECGs using the conventional approach and using the IPI + DDA approach.ResultsA total of 375 interpretations were collected. The IPI + DDA approach was shown to improve diagnostic accuracy by 8.7{\%} (although not statistically significant, p-value = 0.1852), the IPI + DDA suggested the correct interpretation more often than the human interpreter in 7/10 cases (varying statistical significance). Human interpretation accuracy increased to 70{\%} when seven suggestions were generated.ConclusionAlthough results were not found to be statistically significant, we found; 1) our decision support tool increased the number of correct interpretations, 2) the DDA algorithm suggested the correct interpretation more often than humans, and 3) as many as 7 computerized diagnostic suggestions augmented human decision making in ECG interpretation. Statistical significance may be achieved by expanding sample size.",
keywords = "ECG, Decision support, Rule based algorithms, CDSS, DSS. HCI",
author = "Andrew Cairns and Raymond Bond and Dewar Finlay and Daniel Guldenring and Fabio Badilini and Guido Libretti and Aaron Peace and Stephen Leslie",
year = "2017",
month = "8",
day = "9",
doi = "10.1016/j.jelectrocard.2017.08.007",
language = "English",
volume = "50",
pages = "781--786",
journal = "Journal of Electrocardiology",
issn = "0022-0736",
publisher = "Elsevier",
number = "6",

}

A Decision Support System and Rule-based Algorithm to Augment the Human Interpretation of the 12-lead Electrocardiogram. / Cairns, Andrew; Bond, Raymond; Finlay, Dewar; Guldenring, Daniel; Badilini, Fabio; Libretti, Guido; Peace, Aaron; Leslie, Stephen.

In: Journal of Electrocardiology, Vol. 50, No. 6, 09.08.2017, p. 781-786.

Research output: Contribution to journalArticle

TY - JOUR

T1 - A Decision Support System and Rule-based Algorithm to Augment the Human Interpretation of the 12-lead Electrocardiogram

AU - Cairns, Andrew

AU - Bond, Raymond

AU - Finlay, Dewar

AU - Guldenring, Daniel

AU - Badilini, Fabio

AU - Libretti, Guido

AU - Peace, Aaron

AU - Leslie, Stephen

PY - 2017/8/9

Y1 - 2017/8/9

N2 - BackgroundThe 12-lead Electrocardiogram (ECG) has been used to detect cardiac abnormalities in the same format for more than 70 years. However, due to the complex nature of 12-lead ECG interpretation, there is a significant cognitive workload required from the interpreter. This complexity in ECG interpretation often leads to errors in diagnosis and subsequent treatment. We have previously reported on the development of an ECG interpretation support system designed to augment the human interpretation process. This computerised decision support system has been named ‘Interactive Progressive based Interpretation’ (IPI). In this study, a decision support algorithm was built into the IPI system to suggest potential diagnoses based on the interpreter’s annotations of the 12-lead ECG. We hypothesise semi-automatic interpretation using a digital assistant can be an optimal man-machine model for ECG interpretation.Objectives: To improve interpretation accuracy and reduce missed co-abnormalities.Methods: The Differential Diagnoses Algorithm (DDA) was developed using web technologies where diagnostic ECG criteria are defined in an open storage format, Javascript Object Notation (JSON), which is queried using a rule-based reasoning algorithm to suggest diagnoses. To test our hypothesis, a counterbalanced trial was designed where subjects interpreted ECGs using the conventional approach and using the IPI + DDA approach.ResultsA total of 375 interpretations were collected. The IPI + DDA approach was shown to improve diagnostic accuracy by 8.7% (although not statistically significant, p-value = 0.1852), the IPI + DDA suggested the correct interpretation more often than the human interpreter in 7/10 cases (varying statistical significance). Human interpretation accuracy increased to 70% when seven suggestions were generated.ConclusionAlthough results were not found to be statistically significant, we found; 1) our decision support tool increased the number of correct interpretations, 2) the DDA algorithm suggested the correct interpretation more often than humans, and 3) as many as 7 computerized diagnostic suggestions augmented human decision making in ECG interpretation. Statistical significance may be achieved by expanding sample size.

AB - BackgroundThe 12-lead Electrocardiogram (ECG) has been used to detect cardiac abnormalities in the same format for more than 70 years. However, due to the complex nature of 12-lead ECG interpretation, there is a significant cognitive workload required from the interpreter. This complexity in ECG interpretation often leads to errors in diagnosis and subsequent treatment. We have previously reported on the development of an ECG interpretation support system designed to augment the human interpretation process. This computerised decision support system has been named ‘Interactive Progressive based Interpretation’ (IPI). In this study, a decision support algorithm was built into the IPI system to suggest potential diagnoses based on the interpreter’s annotations of the 12-lead ECG. We hypothesise semi-automatic interpretation using a digital assistant can be an optimal man-machine model for ECG interpretation.Objectives: To improve interpretation accuracy and reduce missed co-abnormalities.Methods: The Differential Diagnoses Algorithm (DDA) was developed using web technologies where diagnostic ECG criteria are defined in an open storage format, Javascript Object Notation (JSON), which is queried using a rule-based reasoning algorithm to suggest diagnoses. To test our hypothesis, a counterbalanced trial was designed where subjects interpreted ECGs using the conventional approach and using the IPI + DDA approach.ResultsA total of 375 interpretations were collected. The IPI + DDA approach was shown to improve diagnostic accuracy by 8.7% (although not statistically significant, p-value = 0.1852), the IPI + DDA suggested the correct interpretation more often than the human interpreter in 7/10 cases (varying statistical significance). Human interpretation accuracy increased to 70% when seven suggestions were generated.ConclusionAlthough results were not found to be statistically significant, we found; 1) our decision support tool increased the number of correct interpretations, 2) the DDA algorithm suggested the correct interpretation more often than humans, and 3) as many as 7 computerized diagnostic suggestions augmented human decision making in ECG interpretation. Statistical significance may be achieved by expanding sample size.

KW - ECG

KW - Decision support

KW - Rule based algorithms

KW - CDSS

KW - DSS. HCI

U2 - 10.1016/j.jelectrocard.2017.08.007

DO - 10.1016/j.jelectrocard.2017.08.007

M3 - Article

VL - 50

SP - 781

EP - 786

JO - Journal of Electrocardiology

T2 - Journal of Electrocardiology

JF - Journal of Electrocardiology

SN - 0022-0736

IS - 6

ER -