Human-Computer Agreement in ECG Interpretation for ‘Turned-Down’ Patients Referred to a Primary Percutaneous Coronary Intervention Service

Aleeha Iftikhar, RR Bond, V. E. McGilligan, Stephen Leslie, Charles Knoery, James A Shand, Adesh Ramsewak, Divyesh Sharma, Adam Canning, Anne McShane, Khaled Rjoob, Aaron Peace

Research output: Contribution to journalArticlepeer-review

1 Downloads (Pure)

Abstract

Background: When a patient is suspected of having an acute myocardial infarction (AMI), patients are accepted or ‘turned-down’ for primary percutaneous coronary intervention (PPCI) partly based on clinical assessment of the 12-lead electrocardiogram (ECG) and ST-Elevation Myocardial Infarction (STEMI) criteria. Objective: This paper aims to retrospectively interrogate the agreement rate between the human (specialist nurse called PPCI ‘activator’) and computer interpretations of ECGs for cases where patients are turned-down for PPCI.Methods: Various features of patients who were referred for PPCI were analysed. Both the human and computer ECG interpretations were simplified to either being suggestive or not suggestive of AMI to avoid analysis of complex heterogeneous and synonymous diagnostic terms. Analysis to measure agreement was carried out along with logistic regression to determine if these ECG interpretations (and other variables such as patient age, chest pain) can predict patient mortality.Results: Total of 1464 patients referred for PPCI were turned-down. For these cases, 722 (49%) of the computerised diagnoses were suggestive of AMI whereas 634 (43%) of the human interpretations were suggestive of AMI (P<.001). The human and computer agreed that there was a possible AMI in 342 cases (23.3%). However, both agreed more often that a patient was not having an AMI (n=450 [31%]). The overall agreement rate was 54%. Cohen's kappa coefficient (κ) showed a poor agreement (κ= 0.08 [P =.001]). Other factors including age (odds ratio=1.06, 1.07) and chest pain (odds ratio=0.47, 0.59) were the only independent variables that were statistically significant (P <.01) in predicting mortality after 30 days and 1 year. The odds for mortality within 1 year of referral were lower in patients with chest pain compared to those patients without chest pain. A referral being ‘out of hours’ is a ‘trending’ variable (odds ratio=1.93, 1.41, P=.09) for predicting the odds of 1-year mortality. Other insights related to human and computer performance over hours of the day are also provided. Conclusion: Mortality in patients turned down for PPCI is higher than the reported mortality for STEMI patients at one year. Agreement between computerised and human ECG interpretation is poor perhaps leading to a high rate of inappropriate referrals. Work is needed to improve machine and human decision making when reading ECGs to ensure that patients are signposted to the correct treatment facility for time-critical therapy.
Original languageEnglish
JournalJMIR Medical Informatics
Publication statusAccepted/In press - 17 Jan 2021

Keywords

  • ECG Interpretation
  • Acute Myocardial Infarction
  • Agreement between Human and Computer
  • Primary percutaneous coronary intervention

Fingerprint Dive into the research topics of 'Human-Computer Agreement in ECG Interpretation for ‘Turned-Down’ Patients Referred to a Primary Percutaneous Coronary Intervention Service'. Together they form a unique fingerprint.

Cite this