Front. Med.Frontiers in MedicineFront. Med.2296-858XFrontiers Media S.A.10.3389/fmed.2022.870523MedicineOriginal ResearchArtificial Intelligence-Enabled Electrocardiogram Predicted Left Ventricle Diameter as an Independent Risk Factor of Long-Term Cardiovascular Outcome in Patients With Normal Ejection FractionChenHung-Yi1LinChin-Sheng2FangWen-Hui345LeeChia-Cheng67HoChing-Liang8WangChih-Hung910LinChin511*1Department of Internal Medicine, National Defense Medical Center, Tri-Service General Hospital, Taipei, Taiwan2Division of Cardiology, Department of Internal Medicine, National Defense Medical Center, Tri-Service General Hospital, Taipei, Taiwan3Department of Family and Community Medicine, National Defense Medical Center, Tri-Service General Hospital, Taipei, Taiwan4Department of Internal Medicine, National Defense Medical Center, Tri-Service General Hospital, Taipei, Taiwan5Artificial Intelligence of Things Center, National Defense Medical Center, Tri-Service General Hospital, Taipei, Taiwan6Medical Informatics Office, National Defense Medical Center, Tri-Service General Hospital, Taipei, Taiwan7Division of Colorectal Surgery, Department of Surgery, National Defense Medical Center, Tri-Service General Hospital, Taipei, Taiwan8Division of Hematology and Oncology, Department of Internal Medicine, National Defense Medical Center, Tri-Service General Hospital, Taipei, Taiwan9Department of Otolaryngology-Head and Neck Surgery, National Defense Medical Center, Tri-Service General Hospital, Taipei, Taiwan10National Defense Medical Center, Graduate Institute of Medical Sciences, Taipei, Taiwan11Medical Technology Education Center, National Defense Medical Center, School of Medicine, Taipei, Taiwan
Edited by: Ming-Chin Lin, Taipei Medical University, Taiwan
Reviewed by: Chia-Ter Chao, National Taiwan University Hospital, Taiwan; Belal Alsinglawi, Western Sydney University, Australia
*Correspondence: Chin Lin, xup6fup0629@gmail.com
This article was submitted to Family Medicine and Primary Care, a section of the journal Frontiers in Medicine
This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
Background
Heart failure (HF) is a global disease with increasing prevalence in an aging society. However, the survival rate is poor despite the patient receiving standard treatment. Early identification of patients with a high risk of HF is important but challenging. Left ventricular end-diastolic diameter (LV-D) increase was an independent risk factor of HF and adverse cardiovascular (CV) outcomes. In this study, we aimed to develop an artificial intelligence (AI) enabled electrocardiogram (ECG) system to detect LV-D increase early.
Objective
We developed a deep learning model (DLM) to predict left ventricular end-diastolic and end-systolic diameter (LV-D and LV-S) with internal and external validations and investigated the relationship between ECG-LV-D and echocardiographic LV-D and explored the contributions of ECG-LV-D on future CV outcomes.
Methods
Electrocardiograms and corresponding echocardiography data within 7 days were collected and paired for DLM training with 99,692 ECGs in the development set and 20,197 ECGs in the tuning set. The other 7,551 and 11,644 ECGs were collected from two different hospitals to validate the DLM performance in internal and external validation sets. We analyzed the association and prediction ability of ECG-LVD for CV outcomes, including left ventricular (LV) dysfunction, CV mortality, acute myocardial infarction (AMI), and coronary artery disease (CAD).
Results
The mean absolute errors (MAE) of ECG-LV-D were 5.25/5.29, and the area under the receiver operating characteristic (ROC) curves (AUCs) were 0.8297/0.8072 and 0.9295/0.9148 for the detection of mild (56 ≦ LV-D < 65 mm) and severe (LV-D ≧ 65 mm) LV-D dilation in internal/external validation sets, respectively. Patients with normal ejection fraction (EF) who were identified as high ECHO-LV-D had the higher hazard ratios (HRs) of developing new onset LV dysfunction [HR: 2.34, 95% conference interval (CI): 1.78–3.08], CV mortality (HR 2.30, 95% CI 1.05–5.05), new-onset AMI (HR 2.12, 95% CI 1.36–3.29), and CAD (HR 1.59, 95% CI 1.26–2.00) in the internal validation set. In addition, the ECG-LV-D presents a 1.88-fold risk (95% CI 1.47–2.39) on new-onset LV dysfunction in the external validation set.
Conclusion
The ECG-LV-D not only identifies high-risk patients with normal EF but also serves as an independent risk factor of long-term CV outcomes.
artificial intelligenceelectrocardiogramdeep learningheart failureejection fractionleft ventricular end-diastolic diametercardiovascular outcomeMOST110-2314-B-016-010-MY3MOST110-2321-B-016-002TSGH-B-111020CHNDMC-111-07Ministry of Science and Technology, Taiwan10.13039/501100004663Introduction
Heart failure (HF) is a common clinical entity with increasing prevalence in an aging society, which affects 5.7 million patients and more than 870,000 new cases are diagnosed in the United States every year (1). In developed countries, about 2% of the population lives with HF (1, 2). The American Heart Association forecasted that total costs associated with HF were at $20.9 billion in 2012 and are projected to rise to $53.1 billion by 2030 (3). Currently, HF is classified as reduced ejection fraction (HFrEF), mildly reduced ejection fraction (HFmrEF), and preserved ejection fraction (HFpEF) based on different ejection fraction (EF) levels (4). Multiple modality treatment for the patients with HF, such as renin-angiotensin system inhibition, beta-blocker, and aldosterone antagonist, is evidence-based and recommended in guidelines (4, 5). However, even with treatment, the HF survival rate remains poor globally and the mortality ranged from 17 to 45% in a year among the patients who were admitted to a hospital because of HF (1, 2, 6). Such evidence points out the significant problem of HF in aged society. Early identification of those patients who are at risk to develop HF and adequate risk reduction helps to improve the quality of life, reduce hospitalization, and promote survival outcomes.
In patients with HF, there were several important parameters for the assessment of cardiac functional and structural changes. As EF was the ratio of blood leaving heart each time it contracts, the left ventricular end-diastolic diameter (LV-D) and end-systolic diameter (LV-S) influenced the value of ECHO-EF. The principal ECG changes in patients with increased LV-D and LV-S in LV hypertrophy include augmented QRS amplitude, prolonged QRS conduction time, changes in instantaneous and mean QRS vectors, ST depression and/or T-wave inversion, and P-wave abnormalities, such as left atrial enlargement (7, 8). VF frequency was consistently lower in patients with an increased LV diameter (9). However, these ECG changes were neither sensitive nor specific for increased LV-D or LV-S detection. The EF serves as an indicator for cardiac contractility and a significant predictor of survival (10–13). Previous studies presented that LV-D increase was an independent risk factor of cardiovascular outcomes (14, 15), ventricular arrhythmia inducibility (16), and mortality (17, 18). By the investigation of 1,138 patients with HFrEF and sinus rhythm, Ito et al. proposed strong association between LV diameters and cardiovascular (CV) outcomes, which is independent of ECHO-EF (14). Moreover, in a combination with QRS duration, the LV-D could be applied to identify the patients at risk for tachyarrhythmias. Makaryus et al. revealed myocardial infarction with scar formation or cardiomyopathy with disordered ventricular excitation accounts for the ventricular arrhythmia and poor prognosis in patients with dilated LV-D (16). In patients with mitral regurgitation, the LV-S increase is independently associated with increased mortality even under medical management (19). All the results highlight the significance of EF, LV-D, and LV-S in patients with HF.
Artificial intelligence-based ECG (AI-ECG) has expanded to multiple applications and achieved human-level performance, effectively detecting cardiac diseases with large annotated ECG datasets, including echocardiogram predictions (20, 21), arrhythmia detection (22), dyskalemia and its cause (23–25), glycated hemoglobin (26), digoxin toxicity (27), aortic dissection (28), pneumothorax (29), and myocardial infarction (30–32). Importantly, previous studies revealed significant correlation and predictability between ECG-predicted EF (ECG-EF) and echocardiographic EF (ECHO-EF). This study not only revealed the diagnostic value of ECG on HF but also further identified a new subtype of HF, which has normal ECHO-EF but lower ECG-EF and a high risk of future LV dysfunction (20). Meanwhile, age estimated from ECG (ECG-age) is also a measure of cardiovascular health, and the difference between the ECG-age and the chronological age can be used as a marker of the risk of deaths even in different cohorts (33). The new concept of disease previvor was proposed as individuals who are healthy but have a markedly increased predisposition to develop the disease (34, 35).
However, the discrepancy between ECG-EF and ECHO-EF was not fully interpreted. ECHO-EF is evaluated regularly in echocardiography, similar to other cardiac structure measurements, such as LV-D, LV-S, interventricular, and posterior wall thickness. With the aid of AI-ECG, we hypothesized that AI-ECG predicting LV-D (ECG-LV-D) may provide additional information on CV outcomes in patients with initially normal ECHO-EF, who are recognized as low ECG-EF. Therefore, the aim of this study is to build a deep learning model (DLM) to predict LV-D and LV-S and verify the accuracy by echocardiography in two independent hospitals. Finally, we tried to apply ECG-LV-D in different clinical scenarios and acquire additional information on the prediction of future CV diseases.
Materials and MethodsData Source and Population
This multicenter retrospective study was ethically approved by the institutional review board of Tri-Service General Hospital, Taipei, Taiwan (IRB NO. C202105049). The electronic medical records (EMRs) of our hospital included digital ECG signals, echocardiography images, hospital courses records, and future outcomes between 1 January 2010 and 31 September 2021. We identified patients who had at least one pair of 12-lead ECG and transthoracic echocardiography (TTE) records within 7 days. Subjects with inadequate ECG or echocardiographic information were excluded, such as noise interference, leads dislodge or dislocation, data loss of heart rate, EF, LV-D, or LV-S. The remaining ECGs were annotated by TTE information collected in this study. Finally, there were 75,942 patients in NeiHu General Hospital at NeiHu District (hospital A), an academic medical center in our hospital system, and 11,633 patients in Tingzhou Branch Hospital at Zhongzheng District (hospital B), a community hospital (Figure 1).
Development, tuning, internal validation, and external validation sets generation and the ECG labeling of echocardiogram. Schematic of the dataset creation and analysis strategy, which was devised to assure a robust and reliable dataset for training, validating, and testing of the network. Once a patient’s data were placed in one of the datasets, that individual’s data were used only in that set, avoiding “cross-contamination” among the training, validation, and test datasets. The details of the flowchart and how each of the datasets was used are described in “Materials and Methods” section.
We divided ECGs into development, tuning, internal validation, and external validation sets by different dates and hospitals. For DLM training, there were 99,692 ECGs from 60,790 patients included in development set and 20,197 ECGs from 7,601 patients were included in tuning set. We only used the first records in the validation step for the patients with multiple ECG-TTE pairs, and the internal and external validation sets included 7,551 ECGs before 31 December 2015 in hospital A and 11,644 ECGs in hospital B. No repeated patients were recruited into more than one group.
Observational Variables
The ECGs were acquired at a sampling rate of 500 Hz with a 10-s period using a Philips 12-lead ECG machine (PH080A, Philips Medical Systems, 3000 Minuteman Road Andover, MA 01810 United States). Comprehensive 2D ECG and quantitative data were recorded at the time of the acquisition in a Philips image system for all patients. The LV parameters included EF, LV-D, and LV-S, which were routinely acquired by experienced cardiologists or technicians using standardized methods. The EF was assessed using the Simpson method, M-mode, and the reported visually estimated EF. LV dimensions and wall thickness were measured by M mode under para-sternal long axis view and recorded by millimeter. The cut-off values of EF are 50 and 35% as mild and severe LV dysfunction, which are comparable criteria described in previous studies (20, 34, 36, 37). We selected LV-D and LV-S as they can be measured more easily and are more reproducible than other indices. Patients were divided into three groups according to LV-D at initial echocardiography: ≤ 56 mm (normal), 56 < LV-D ≤ 65 mm (mild increase), and > 65 mm (severe increase). The criteria for LV-S were ≤ 38 mm (normal), 38 < LV-S ≤ 45 mm (mild increase), and > 45 mm (severe increase). These diameters were determined according to the reference values for LV size from studies based on ethnic-appropriate population datasets (18, 38–43).
The demographic characteristics were obtained in our EMRs and disease history before the index date of ECG was collected using the corresponding code of International Classification of Disease, Ninth Revision and Tenth Revision (ICD-9 and ICD-10, respectively), as described previously (24, 26, 32, 44). The remaining echocardiographic parameters, such as interventricular septum (IVS) diameter, left ventricular posterior wall (LVPW) diameter, left atrium (LA) size, aortic root (AO) diameter, right ventricular (RV) diameter, pulmonary artery systolic pressure (PASP), and pericardial effusion (PE), were also collected in this study.
According to the promising ability of disease previvor identification by AI-ECG, we analyzed the correlation between ECG-LV-D increased and new-onset LV dysfunction, defined as ECHO-EF ≤ 35. Moreover, patients’ data were censored at the last known TTE examination to limit bias from incomplete records. In addition to LV dysfunction, we followed and analyzed other three CV outcomes, including CV mortality, new-onset acute myocardial infarction (AMI), and new-onset coronary artery disease (CAD). CV mortality included arrhythmia-related death, acute coronary syndrome-related death, stroke death, and HF-related death. These outcomes were censored at the patient’s last known hospital alive encounter without corresponding events to limit bias from incomplete records. The end of follow-up in this study was 30 September 2021 for all the above outcomes.
The Implementation of the Deep Learning Model
The ECG-based EF, LV-D, and LV-S were, respectively, considered as function score and structure status of the heart, both estimated by DLMs. The ECG12Net architecture with 82 convolutional layers and an attention mechanism was used for estimation and the technology details, such as model architecture, data augmentation, and model visualization, were described previously (24). We used an oversampling process to adequately recognize extreme EF, LV-D, and LV-S values. The process was based on weights computed based on the prevalence of 20 equidistant intervals in the development set. The output of these DLMs was a continuous estimation value of actual EF, LV-D, and LV-S, which was called ECG-EF, ECG-LV-D, and ECG-LV-S, respectively.
Statistical Analysis and Model Performance Assessment
Patient characteristics are presented as numbers of patients, population percentages, means, and standard deviations (SDs), with the significance level set as p < 0.05. We used scatter plots to describe the predicted value by ECG voltage-time traces compared with actual EF and left ventricular diameters (LV-D/LV-S). The accuracy of DLMs was evaluated by mean difference (Diff), Pearson’s correlation coefficients (r), and mean absolute errors (MAEs), calculated in both internal and external validation sets. The diagnostic value of DLMs was measured with the receiver operating characteristic (ROC) curve and the area under the curve (AUC). The tuning set was used to decide the operating point based on the maximum of Yunden’s index, which was calculated for the corresponding sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) in both validation sets. To identify the underlying subtype of patients with no correspondence between ECG-EF and ECHO-EF, the proportion of patients with larger ECHO/ECG-LV-D were explored in diverse ECHO/ECG-EF groups for the disease previvors of future LV dysfunction.
The relationship between traditional ECG features and AI-ECG-based ECG-LV-D was also analyzed. We showed the importance rank of different traditional ECG features, including 31 diagnostic pattern classes and 8 continuous ECG measurements based on an automatic Philips analysis system. These features were used to train an eXtreme gradient boosting (XGB) model to predict ECG-LV-D. To identify the most important ECG features in this analysis, the stepwise program was used and the p-value to enter and to remove were 0.05 and 0.15, respectively.
To investigate the long-term incidence of developing new-onset LV dysfunction, we plotted Kaplan–Meier curves of patients with an initially normal EF (EF > 50%), stratified by ECG-EF, left ventricle (end-diastole) diameter (LV-D), and ECG-LV-D. Multivariable Cox proportional hazard models were used to evaluate the predictive ability of ECG-EF, ECHO-LV-D, and ECG-LV-D adjusted by gender and age on all outcomes of interested, presenting in hazard ratios (HRs) and 95% conference intervals (95% CIs). We assessed the risk of adverse CV outcomes in patients with different ECG-EF/ECG-LV-D using a Cox proportional hazard model after adjusting by gender and age and demonstrated the risk matrixes of different outcomes with HRs and the concordance statistic (C-index), which were used to quantify their contributions. All the statistical analyses were conducted in R software, version 3.4.4.
Results
The baseline characteristics of patients, including disease histories and echocardiographic data are presented in Table 1 for the development, tuning, internal validation, and external validation sets. In internal and external validation sets, 3,810 (50.5%) and 5,760 (49.5%) patients were men, and mean age was 63.4 and 65.7 years, respectively. According to disease history, there were 2,248 (29.8%) and 3,612 (31.0%) patients with diabetes mellitus (DM), 3,938 (52.2%) and 6,435 (55.3%) with hypertension (HTN), 3,125 (41.4%) and 5,176 (44.5%) with hyperlipidemia (HLP), 245 (3.2%) and 270 (2.4%) with AMI, 2,358 (31.2%) and 3,630 (31.2%) with CAD, and 957 (12.7%) and 1,484 (12.7%) with HF. The echocardiographic characteristics are similar between internal and external validation sets, such as EF (65.3%/65.5%), LV-D (47.4 mm/47.1 mm), and LV-S (29.8 mm/29.6 mm).
Figure 2 demonstrated the accuracy of DLMs with the scatter plots of ECG-based LV parameters compared to actual ones. The ECG-EF showed a high correlation with the Diff of 1.23 ± 10.52/1.21 ± 10.45, Pearson’s correlation coefficients (r) of 0.59/0.56, and MAEs of 7.95/7.91 in the internal/external validation set, respectively. Meanwhile, the similar correlation was observed in our analysis of ECG-LV-D and ECG-LV-S, with Diff of 0.03 ± 6.75/0.86 ± 6.27, r of 0.53/0.59, and MAE of 5.26/4.83 in the internal validation set, and Diff of 0.06 ± 6.81/0.78 ± 6.40, r of 0.49/0.53, and MAE of 5.29/4.93 in the external validation set.
Scatter plots of predicted value via ECG voltage–time traces only compared with the actual ejection fraction (EF) and left ventricle (end-diastole/end-systole) (LV-D/LV-S). The x-axis indicates the actual value and the y-axis presents the ECG-predictions. Red points represent the highest density, followed by yellow, green light blue, and dark blue. We presented the mean difference (Diff), Pearson’s correlation coefficients (r), and mean absolute errors (MAEs) to demonstrate the accuracy of a deep learning model (DLM). The black lines with 95% conference intervals (CIs) are fitted via simple linear regression.
The ROC curve analysis was used to test the diagnostic value of AI-enabled ECG parameters (Figure 3). The AUCs of ECG-EF for mild/severe reduced EF in the internal validation set were 0.8793/0.9618, with a percentage of sensitivity of 69.6/86.8, specificity of 89.1/92.5, PPV of 42.4/28.3, and NPV of 96.2/99.5. Meanwhile, the AUCs of ECG-LV-D for detecting mild/severe increased ECHO-LV-D were 0.8297/0.9295 with the percentage of sensitivity of 66.6/80.2, specificity of 82.2/88.1, PPV of 27.4/9.5, and NPV of 96.1/99.7, and the AUCs of ECG-LV-S were 0.8821/0.9471 with the percentage of sensitivity of 70.1/87.0, specificity of 88.3/89.6, PPV of 35.2/20.9, and NPV of 97.0/99.5. The external validation analysis validated the generalization ability of DLMs in a heterogeneous population (AUC = 0.8816/0.9447 in ECG-EF, 0.8072/0.9148 in ECG-LV-D, and 0.8485/0.9363 in ECG-LV-S). These results revealed the possibility to detect abnormal EF/LV-D/LV-S via ECG accurately.
Receiver operating characteristic (ROC) curve analysis for mild to severe left ventricle abnormality from deep learning model based ECG voltage–time traces. The ROC curve (x-axis = specificity and y-axis = sensitivity) and area under ROC curve (AUC) were calculated using the internal validation set (A) and external validation set (B). The operating point was selected based on the maximum of Yunden’s index in tuning set, which was used for calculating the corresponding sensitivities and specificities in two validation sets.
Subgroup analysis was stratified by the different clinical settings and comorbidities in Figure 4. DLM performed better in patients from the out-patient department (OPD) than those from the emergency room (ER) or the inpatient department (IPD). Compared to patients without comorbidities, ECG-EF, ECG-LV-D, and ECG-LV-S had lower AUC in patients with comorbidities, especially in patients with a history of AMI. These comorbidities may be potential confounding factors for new-onset LV dysfunction (45, 46). In other words, electrical abnormalities induced by comorbidities may cause ECG changes that interfere with the performance of our DLM.
Stratified analysis for model performance for predicting electrocardiogram-based ejection fraction (ECG-EF), left ventricular end-diastolic diameter (LV-D), and left ventricular end-systolic diameter (LV-S). The analyses were stratified by the disease histories or data source. The AUC and 95% CIs were presented based on LV EFs and diameters. ER, Emergency room; IPD, inpatient department; OPD, outpatient department; DM, diabetes mellitus; HTN, hypertension; HLP, hyperlipidemia; CKD, chronic kidney disease; AMI, acute myocardial infarction; STK, stroke; CAD, coronary artery disease; HF, heart failure; Afib, atrial fibrillation; COPD, chronic obstructive pulmonary disease (COPD).
In the previous study, we noticed patients with low ECG-EF and normal ECHO-EF had a higher incidence of future LV dysfunction. We hypothesized that the disease previvor was associated with obscure structural abnormalities, which could be detected by ECG-LV-D before actual LV dilation. Our DLM exhibited similar performance in predicting the size of LV-D and LV-S (Figure 3). Due to the similar clinical meaning of LV-S and LV-D in association with EF, we applied LV-D for further analysis. Figure 5 presents the scatter plots of predicted and actual EF correlated with LV-D. Initially, we applied ECHO-LV-D in the internal validation set but only 15.2% of patients with low ECG-EF and normal ECHO-EF were identified as the mild increase (>56 mm) in the internal validation set, however, the percentage increased to 65.8% in ECG-LV-D application group. In the external validation set, the percentage increased from 20.0 to 61.1% similarly. These results may reveal the importance of ECG-LV-D on previvors detection.
Scatter plots of predicted and actual EF correlated with LV-D. The x-axis indicates the actual EF and the y-axis presents the ECG-EF. Green to red points represent the small and large predicted and actual LV-D, respectively. The percentages were the proportion of people with an ECHO/ECG LV-D > 56 mm in each ECHO and ECG EF group.
Figure 6 demonstrated the relationship between known ECG features and ECG-LV-D. Our DLM identified those patients with increased ECG-LV-D were associated with the ECG features of ischemia/infarction, atrial fibrillation, tachycardia, left ventricular hypertrophy, widening QRS duration, prolonged PR interval, prolonged QT interval, augmented QRS amplitude, higher T-wave axis, lower RS wave axis, and lower P-wave axis compared to the ECG of normal patients. The explainable variation of known ECG features for DLM-based ECG-LV-D was 41.89 and 37.28% in the internal and external validation sets, respectively, which suggested that DLM could extract more than 50% additional information from raw ECGs.
Relationship between most important ECG features and ECG estimated left ventricle (end-diastole) (ECG-LV-D). The related importance is based on the information gain of eXtreme gradient boosting (XGB) model, and the R-square (R-sq) is the coefficient of determination to use selected ECG features for predicting ECG-LV-D. The AI-ECG predictions were classified as ECG-normal (ECG-LV-D ≤ 56) and ECG-abnormal (ECG-LV-D > 56). The analyses are conducted both in internal and external validation sets (***p < 0.001).
In Figure 7, a long-term incidence of developing a new-onset LV dysfunction in the patient with initially normal EF was presented. We stratified by ECG-EF, ECHO-LV-D, and ECG-LV-D and defined normal patient groups as reference. There were 6,083 patients and 9,281 patients at risk cases and the cumulative incidence rates in the low ECG-EF (false positive) group were percentages of 32.0/44.4/44.4 and 31.7/36.0/52.0 at 2/4/6 years in the internal and external validation sets, respectively, with corresponding significant gender-age adjusted HRs (95% CI) of 5.91 (3.58–9.78) and 5.63 (3.55–8.93). The C-index analyses also show the significant prognostic value on new onset LV dysfunction of 0.774 (95% CI: 0.753–0.7950) and 0.791 (95% CI: 0.773–0.808), which emphasized the importance of ECG-EF. In the analyses of ECHO-LV-D and ECG-LV-D, the significant gender-age adjusted HRs demonstrated the contributions on new-onset LV dysfunction in both validation sets. The HRs of severe/mild ECG-LV-D increase was 7.30 (95% CI 3.61–14.77)/3.12 (95% CI 2.41–4.03) in the internal validation set and 5.51 (95% CI 2.85–10.66)/2.65 (95% CI 2.11–3.33) in the external validation set. The C-indexes were higher in ECG-LV-D (0.750, 95% CI 0.727–0.772) than in ECHO-LV-D (0.723, 95% CI 0.699–0.747) in internal validation set, which was consistent in external validation set [0.750 (95% CI: 0.730–0.769) vs. 0.737 (95% CI 0.718–0.757)]. It suggested that ECG-LV-D may be a better differential indicator than ECHO-LV-D, which supplements the ECG-EF to identify patients at the risk of LV dysfunction in future.
Long-term incidence of developing a new-onset left ventricular dysfunction (LVD, EF ≤ 35%) in patients with an initially normal EF (EF > 50%) stratified by ECG-EF, LV-D, and ECG-LV-D. The C-index is calculated based on the continuous value combined with sex and age. The analyses are conducted both in internal and external validation sets. The table shows the at-risk population and cumulative risk for the given time intervals in each risk stratification.
Figure 8 shows the risk matrixes of different ECG-EF and ECG-LV-D on adverse events in patients with normal ECHO-EF. The patients with increased ECG-LV-D were more susceptible to adverse CV outcomes. Combining ECG-EF and ECG-LV-D, the gender-age-adjusted HRs increased to 4.60 (95% CI 3.17–6.68), 4.31 (95% CI 1.68–11.07), 4.80 (95% CI 2.78–8.28), and 2.23 (95% CI 1.65–3.31) on new-onset LV dysfunction, CV mortality, new-onset AMI, and CAD, respectively. Moreover, the ECG-LV-D independently provided the ability of risk stratification on new-onset LV dysfunction (HR 2.34, 95% CI 1.78–3.08), CV mortality (HR 2.30, 95% CI 1.05–5.05), new-onset AMI (HR 2.12, 95% CI 1.36–3.29), and CAD (HR 1.59, 95% CI 1.26–2.00) in the internal validation set, and achieved similar trends with 1.88-fold-risk (95% CI 1.47–2.39) of new-onset LV dysfunction in the external validation set. In the consideration of confounding bias, we further adjusted more potential confounding factors, such as comorbidities. Our data indicated that the trend of results was similar with results adjusted by gender, age, and comorbidities (Supplementary Figure 1), which emphasized the importance and independency of ECG-EF and ECG-LV-D on early identification of HF risk.
Risk matrixes of different predicted ejection fraction (ECG-EF) and left ventricle (end-diastole) (ECG-LV-D) groups on adverse events in patients with an initially normal EF (EF > 50%). The hazard ratios (HRs) are based on the Cox proportional hazard model adjusted by gender and age. The color gradient represents the risk of corresponding group, and the non-significant results are defined as white.
Discussion
In this study, we reported an AI-ECG DLM including more than 110,000 pairs of ECG and echocardiographic data and analyzed the longitudinal data, such as EF reduction, mortality, and adverse CV outcomes. Our DLM predicts ECG-EF accurately with the high AUCs of 0.9618/0.9447 for reduced EF detection (EF ≤ 35%) in the internal/external validation set, respectively. The high correlation between ECHO-EF and ECG-EF suggested the latter is a potential diagnostic tool. Severe/mild ECG-LV-D increase with the AUCs of 0.9295/0.8297 and 0.9148/0.8072 in internal/external validation set, which exhibited its valuable diagnostic power in patients with normal ECHO-EF. Moreover, we found a higher prevalence of ECG-LV-D increase in patients with low ECG-EF. Of these false positive patients, gender and age-adjusted HRs of future LV dysfunction were significantly high, suggesting that the DLM identified high-risk patients. Most importantly, the ECG-LV-D additionally contributes to predicting future LV dysfunction, which may provide the information of prognosis independently. The HRs of adverse CV outcomes increased significantly in patients identified as high ECG-LV-D and low ECG-EF compared with those with normal ECG-LV-D and ECG-EF. This is the first research to describe AI-enabled ECG-LV-D, which was demonstrated with high accuracy for the prediction of future LV dysfunction in patients with initially normal ECHO-EF.
Heart failure is an increasing problem affecting more than 30 million people globally. In these patients, asymptomatic LV dysfunction (ALVD, EF < 50%) patients are difficult to diagnose, who account for 7.9–23% of population (4, 5). Patients with ALVD were associated with the reduced quality of life, increased hospitalization, morbidity, and mortality (47, 48). Although current evidence highlights the significance of ALVD and emphasized the early intervention to these patients, there is no effective tool to screen patients with ALVD (49–53). In previous studies for LV dysfunction detection, Kwon et al. proved that the DLM outperformed other machine-learning methods (54). Even with different sex, age, and body mass index, Attia et al. and Cho et al. have demonstrated ECG-EF performance stability and robustness in internal and external validation sets (36, 55, 56). Our DLM exhibits excellent predictive performance in ECG-EF and ECG-LV-D. The concept of ECG-LV-D is proposed to expand the application of ECG-EF and tried to explain the discrepancy between ECG-EF and ECHO-EF. ECG-LV-D is thought to be a structural indicator with subtle electrical signal changes which provides critical information that helps to early identify those patients who are at risk to develop LV dysfunction. In combination with ECG-EF, the diagnostic power significantly enhanced, which could be applied for large-scale screening and for patients with asymptomatic HF to improve their CV outcomes.
There are several ECG changes in LV-D increase. In dilated cardiomyopathy (DCM), about 80% of patients had ECG abnormalities, including LV hypertrophy, left/right atrial enlargement, left/right bundle branch block, abnormal Q wave, atrial fibrillation, first-degree atrial-ventricular block, and T-wave inversion in inferior and anterolateral leads (57). Merlo et al. demonstrated that LV hypertrophy, increased heart rate, and anterior T-wave inversion predicted death or heart transplantation in patients with DCM and ECHO-EF < 50% (58). Previous studies proposed that delayed LV conduction with QRS prolongation (≥ 120 ms) was associated with restrictive LV filling, more advanced myocardial disease, worse LV function, poorer prognosis, and a higher all-cause mortality rate (59, 60). We found that our DLM was strongly correlated with prolonged QRS duration, which partly explained why the patients with high ECG-LV-D had a higher risk of LV dysfunction compared to patients with normal ECG-LV-D. Meanwhile, the possible mechanisms underlying the interference of DLM performance among patients with AMI could be myocardial scarring, which may affect electrical vectors, create regions of slowed conduction, and re-entrant circuits supporting sustained ventricular tachycardia (61, 62). Along with ECG-EF, the ECG-LV-D performed significantly better prediction capacity on new-onset LV dysfunction, CV mortality, new-onset AMI, and CAD compared to ECG-EF alone in the internal validation set. However, in the external validation set, in which the data from mild disease patients in community hospital, only the prediction of LV dysfunction could be significantly enhanced. Possible reasons underlying the inconsistency include different patient population and disease severities. Considering the better performance of our DLM in patients with less comorbidities from OPD than those from ER or IPD, our DLM could be more suitable for community screening than for hospitalized patients. Further large-scale studies are needed to confirm the combination effects of ECG-LV-D and ECG-EF.
The clinical application of AI-ECG is a worldwide tendency and developed rapidly. As the AI-ECG could predict the disease development in healthy individuals without abnormal imaging findings or symptoms, the concept of previvors was proposed recently. With apparent false positive AI-ECG findings, patients with a higher risk of many diseases, such as LV dysfunction (20), future atrial fibrillation (63), hyperkalemia (64), and elder heart age (44), could receive preventive interventions or medical surveillance early.
The importance and clinical significance of our ECG-LV-D should be emphasized. Both ECG-EF and ECG-LV-D are promising screening tools for patients who had a high risk of future LV dysfunction. The advantage of timely HF risk identification is evident to prevent adverse CV events and reduce medical costs. Moreover, from a large community-based study of sudden cardiac death (SCD), LV-D may contribute to the risk of SCD independent of the EF (41). The ECG-EF and ECG-LV-D models could be applied for risk stratification in patients with HF, especially those with stage A or B HF (65). Importantly, the wearable devices with ECG-EF and ECG-LV-D algorithms would provide timely conditions and beneficial effects for high-risk patients. Finally, considering that ECG is widely used and is a standardized examination in a rural or remote hospital, the AI-ECG could analyze and alert physician automatically and immediately among these areas. Further community-based studies of ECG-LV-D application are necessary to validate clinical benefits on HF patient care.
There are some limitations to this study. First, this study was a retrospective study. Although ECG/ECHO pairs were collected and the DLM was validated, the accuracy in different hospital settings and prospective studies are necessary to generalize the application of ECG-LV-D and promote treatment strategy. Second, the clinical impact of treatment is needed to verify. The actual benefit of ECG-LV-D import to clinical practice is not clear now. Investigation of clinical benefits including accidental HF detection, time reduction, prognosis management, and outcomes evaluation should be conducted. Third, the best application of AI-ECG is to screen asymptomatic patients with HF, but the relationship between abnormal ECG and HF symptoms was unclear. Future study should conduct a large-scale community screening to validate the benefit in asymptomatic patients with HF. Fourth, AI-ECG performed worse in patients with more comorbidities, especially in patients with a history of AMI. Interestingly, even after the adjustment of all the confounding factors, our models of ECG-EF and ECG-LV-D still provide significant predictive power for newly onset LV dysfunction. Finally, the DLM design is an uninterpretable set of methods, such as a black box, and full interpretability will be a focus of future work.
In conclusion, our AI-ECG DLM could identify patients with high ECG-LV-D and predict future LV dysfunction. ECG-LV-D serves as an independent risk factor of long-term CV outcomes in patients with normal ECHO-EF and low ECG-EF. The combination of ECG-EF and ECG-LV-D provides significantly synergistic diagnostic power to predict patients with future LV dysfunction. Although further studies are needed, our ECG-LV-D could be used as a screening tool for patients with normal EF but with high cardiovascular risk to initiate appropriate treatment in time.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.
Author Contributions
CL, C-SL, and W-HF contributed to conception and design of the study. CL, C-HW, and C-CL organized the database. CL and C-SL performed the statistical analysis and wrote sections of the manuscript. H-YC and C-SL wrote the first draft of the manuscript. All authors contributed to manuscript revision, read, and approved the submitted version.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Funding
This study was supported by funding from the Ministry of Science and Technology, Taiwan (MOST110-2314-B-016-010-MY3 to CL and MOST110-2321-B-016-002 to C-HW), the Tri-Service General Hospital, Taiwan (TSGH-B-111020 to C-LH), and the Cheng Hsin General Hospital, Taiwan (CHNDMC-111-07 to CL).
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2022.870523/full#supplementary-material
ReferencesZiaeianBFonarowGC.Epidemiology and aetiology of heart failure.Nat Rev Cardiol. (2016) 13:368–78. 10.1038/nrcardio.2016.2526935038PonikowskiPAnkerSDAlHabibKFCowieMRForceTLHuSHeart failure: preventing disease and death worldwide.ESC Heart Fail. (2014) 1:4–25. 10.1002/ehf2.1200528834669HeidenreichPAAlbertNMAllenLABluemkeDAButlerJFonarowGCForecasting the impact of heart failure in the united states: a policy statement from the American heart association.Circ Heart Fail. (2013) 6:606–19. 10.1161/HHF.0b013e318291329a23616602YancyCWJessupMBozkurtBButlerJCaseyDEJrColvinMM2017 Acc/Aha/Hfsa focused update of the 2013 Accf/Aha guideline for the management of heart failure: a report of the american college of cardiology/american heart association task force on clinical practice guidelines and the heart failure society of America.J Am Coll Cardiol. (2017) 70:776–803. 10.1016/j.jacc.2017.04.02528461007YancyCWJessupMBozkurtBButlerJCaseyDEJrDraznerMH2013 Accf/Aha guideline for the management of heart failure: a report of the American college of cardiology foundation/American heart association task force on practice guidelines.J Am Coll Cardiol. (2013) 62:e147–239. 10.1016/j.jacc.2013.05.01923747642AmbrosyAPFonarowGCButlerJChioncelOGreeneSJVaduganathanMThe global health and economic burden of hospitalizations for heart failure: lessons learned from hospitalized heart failure registries.J Am Coll Cardiol. (2014) 63:1123–33. 10.1016/j.jacc.2013.11.05324491689BudhwaniNPatelSDwyerEM.Electrocardiographic diagnosis of left ventricular hypertrophy: the effect of left ventricular wall thickness, size, and mass on the specific criteria for left ventricular hypertrophy.Am Heart J. (2005) 149:709–14. 10.1016/j.ahj.2004.07.04015990757HancockEWDealBJMirvisDMOkinPKligfieldPGettesLS.Aha/Accf/Hrs recommendations for the standardization and interpretation of the electrocardiogram.Circulation. (2009) 119:e251–61. 10.1161/CIRCULATIONAHA.108.19109719228820BonnesJLThannhauserJNasJWestraSWJansenRMGMeinsmaGVentricular fibrillation waveform characteristics of the surface ECG: impact of the left ventricular diameter and mass.Resuscitation. (2017) 115:82–9. 10.1016/j.resuscitation.2017.03.02928363820MoyssakisIMoschosNTriposkiadisFHallaqYPantazopoulosNAessoposALeft ventricular end-systolic stress/diameter relation as a contractility index and as a predictor of survival. Independence of preload after normalization for end-diastolic diameter.Heart Vessels. (2005) 20:191–8. 10.1007/s00380-005-0832-x16160899KatzAM.Cardiomyopathy of overload. A major determinant of prognosis in congestive heart failure.N Engl J Med. (1990) 322:100–10. 10.1056/NEJM1990011132202062403651RihalCSNishimuraRAHatleLKBaileyKRTajikAJ.Systolic and diastolic dysfunction in patients with clinical diagnosis of dilated cardiomyopathy. Relation to symptoms and prognosis.Circulation. (1994) 90:2772–9. 10.1161/01.cir.90.6.2772DecGWFusterV.Idiopathic dilated cardiomyopathy.N Engl J Med. (1994) 331:1564–75. 10.1056/nejm1994120833123077969328ItoKLiSHommaSThompsonJLPBuchsbaumRMatsumotoKLeft ventricular dimensions and cardiovascular outcomes in systolic heart failure: the Warcef trial.ESC Heart Fail. (2021) 8:4997–5009. 10.1002/ehf2.1356034545701VasanRSLarsonMGBenjaminEJEvansJCLevyD.Left ventricular dilatation and the risk of congestive heart failure in people without myocardial infarction.N Engl J Med. (1997) 336:1350–5. 10.1056/nejm1997050833619039134875MakaryusANCatanzaroJNHametzCDJadonathRL.Clinical investigation: utility of left ventricular end diastolic diameter in the prediction of susceptibility to ventricular tachyarrhythmias.Int J Cardiol. (2007) 120:399–403. 10.1016/j.ijcard.2006.10.03017188377InoueTOgawaTIwabuchiYOtsukaKNittaK.Left ventricular end-diastolic diameter is an independent predictor of mortality in hemodialysis patients.Ther Apher Dial. (2012) 16:134–41. 10.1111/j.1744-9987.2011.01048.x22458391SegawaKSugawaraNMaruoKKimuraKKomakiHTakahashiYLeft ventricular end-diastolic diameter and cardiac mortality in duchenne muscular dystrophy.Neuropsychiatr Dis Treat. (2020) 16:171–8. 10.2147/NDT.S23516632021209TribouilloyCGrigioniFAvierinosJFBarbieriARusinaruDSzymanskiCSurvival implication of left ventricular end-systolic diameter in mitral regurgitation due to flail leaflets: a long-term follow-up multicenter study.J Am Coll Cardiol. (2009) 54:1961–8. 10.1016/j.jacc.2009.06.04719909877AttiaZIKapaSLopez-JimenezFMcKiePMLadewigDJSatamGScreening for cardiac contractile dysfunction using an artificial intelligence-enabled electrocardiogram.Nat Med. (2019) 25:70–4. 10.1038/s41591-018-0240-230617318LouYSLinCSFangWHLeeCCHoCLWangCHArtificial intelligence-enabled electrocardiogram estimates left atrium enlargement as a predictor of future cardiovascular disease.J Pers Med. (2022) 12:315. 10.3390/jpm1202031535207802HannunAYRajpurkarPHaghpanahiMTisonGHBournCTurakhiaMPCardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network.Nat Med. (2019) 25:65–9. 10.1038/s41591-018-0268-330617320GallowayCDValysAVShreibatiJBTreimanDLPettersonFLGundotraVPDevelopment and validation of a deep-learning model to screen for hyperkalemia from the electrocardiogram.JAMA Cardiol. (2019) 4:428–36. 10.1001/jamacardio.2019.064030942845LinCSLinCFangWHHsuCJChenSJHuangKHA deep-learning algorithm (Ecg12net) for detecting hypokalemia and hyperkalemia by electrocardiography: algorithm development.JMIR Med Inform. (2020) 8:e15931. 10.2196/1593132134388LinCLinC-SLeeD-JLeeC-CChenS-JTsaiS-HArtificial intelligence assisted electrocardiography for early diagnosis of thyrotoxic periodic paralysis.J Endocr Soc. (2021) 5:bvab120. 10.1210/jendso/bvab12034308091LinCSLeeYTFangWHLouYSKuoFCLeeCCDeep learning algorithm for management of diabetes mellitus via electrocardiogram-based glycated hemoglobin (ECG-HbA1c): a retrospective cohort study.J Pers Med. (2021) 11:725. 10.3390/jpm1108072534442369ChangD-WLinC-STsaoT-PLeeC-CChenJ-TTsaiC-SDetecting digoxin toxicity by artificial intelligence-assisted electrocardiography.Int J Environ Res Public Health. (2021) 18:3839. 10.3390/ijerph1807383933917563LiuWTLinCSTsaoTPLeeCCChengCCChenJTA deep-learning algorithm-enhanced system integrating electrocardiograms and chest X-rays for diagnosing aortic dissection.Can J Cardiol. (2022) 38:160–8. 10.1016/j.cjca.2021.09.02834619339LeeCCLinCSTsaiCSTsaoTPChengCCLiouJTA deep learning-based system capable of detecting pneumothorax via electrocardiogram.Eur J Trauma Emerg Surg. (2022). 10.1007/s00068-022-01904-3[Epub ahead of print]. 35166869ChoYKwonJMKimKHMedina-InojosaJRJeonKHChoSArtificial intelligence algorithm for detecting myocardial infarction using six-lead electrocardiography.Sci Rep. (2020) 10:20495. 10.1038/s41598-020-77599-633235279LiuWCLinCLinCSTsaiMCChenSJTsaiSHAn artificial intelligence-based alarm strategy facilitates management of acute myocardial infarction.J Pers Med. (2021) 11:1149. 10.3390/jpm1111114934834501LiuWCLinCSTsaiCSTsaoTPChengCCLiouJTA deep-learning algorithm for detecting acute myocardial infarction.Eurointervention. (2021) 17:765–73. 10.4244/eij-d-20-0115533840640LimaEMRibeiroAHPaixãoGMMRibeiroMHPinto-FilhoMMGomesPRDeep neural network-estimated electrocardiographic age as a mortality predictor.Nat Commun. (2021) 12:5117. 10.1038/s41467-021-25351-734433816AttiaZIHarmonDMBehrERFriedmanPA.Application of artificial intelligence to the electrocardiogram.Eur Heart J. (2021) 42:4717–30. 10.1093/eurheartj/ehab64934534279VardasPEAsselbergsFWvan SmedenMFriedmanP.The year in cardiovascular medicine 2021: digital health and innovation.Eur Heart J. (2022) 43:271–9. 10.1093/eurheartj/ehab87434974610AttiaIZTsengASBenaventeEDMedina-InojosaJRClarkTGMalyutinaSExternal validation of a deep learning electrocardiogram algorithm to detect ventricular dysfunction.Int J Cardiol. (2021) 329:130–5. 10.1016/j.ijcard.2020.12.06533400971VaidAJohnsonKWBadgeleyMASomaniSSBicakMLandiIUsing deep-learning algorithms to simultaneously identify right and left ventricular dysfunction from the electrocardiogram.JACC Cardiovasc Imaging. (2022) 15:395–410. 10.1016/j.jcmg.2021.08.00434656465NaguehSFSmisethOAAppletonCPByrdBFDokainishHEdvardsenTRecommendations for the evaluation of left ventricular diastolic function by echocardiography: an update from the American society of echocardiography and the European association of cardiovascular imaging.J Am Soc Echocardiogr. (2016) 29:277–314. 10.1016/j.echo.2016.01.01127037982LangRMBadanoLPMor-AviVAfilaloJArmstrongAErnandeLRecommendations for cardiac chamber quantification by echocardiography in adults: an update from the American society of echocardiography and the European association of cardiovascular imaging.Eur Heart J Cardiovasc Imaging. (2015) 16:233–71. 10.1093/ehjci/jev01425712077PoppeKKDoughtyRNGardinJMHobbsFDRMcMurrayJJVNaguehSFEthnic-specific normative reference values for echocardiographic La and Lv Size, Lv mass, and systolic function: the echonormal study.JACC Cardiovasc Imaging. (2015) 8:656–65. 10.1016/j.jcmg.2015.02.01425981507NarayananKReinierKTeodorescuCUy-EvanadoAAleongRChughHLeft ventricular diameter and risk stratification for sudden cardiac death.J Am Heart Assoc. (2014) 3:e001193. 10.1161/jaha.114.00119325227407LangRMBierigMDevereuxRBFlachskampfFAFosterEPellikkaPARecommendations for chamber quantification: a report from the American society of echocardiography’s guidelines and standards committee and the chamber quantification writing group, developed in conjunction with the European association of echocardiography, a branch of the European society of cardiology.J Am Soc Echocardiogr. (2005) 18:1440–63. 10.1016/j.echo.2005.10.00516376782SekoYKatoTMoritaYYamajiYHarunaYIzumiTAge- and body size-adjusted left ventricular end-diastolic dimension in a Japanese hospital-based population.Circ J. (2019) 83:604–13. 10.1253/circj.CJ-18-109530700662ChangC-HLinC-SLuoY-SLeeY-TLinC.Electrocardiogram-based heart age estimation by a deep learning model provides more information on the incidence of cardiovascular disorders.Front Cardiovasc Med. (2022) 9:754909. 10.3389/fcvm.2022.75490935211522KuznetsovaTHerbotsLJinYStolarz-SkrzypekKStaessenJA.Systolic and diastolic left ventricular dysfunction: from risk factors to overt heart failure.Expert Rev Cardiovasc Ther. (2010) 8:251–8. 10.1586/erc.10.320136611ZhengCChenZZhangLWangXDongYWangJMetabolic risk factors and left ventricular diastolic function in middle-aged Chinese living in the Tibetan plateau.J Am Heart Assoc. (2019) 8:e010454. 10.1161/JAHA.118.01045430871396SaraJDToyaTTaherRLermanAGershBAnavekarNS.Asymptomatic left ventricle systolic dysfunction.Eur Cardiol. (2020) 15:e13. 10.15420/ecr.2019.1432373186GoldbergLRJessupM.Stage B heart failure: management of asymptomatic left ventricular systolic dysfunction.Circulation. (2006) 113:2851–60. 10.1161/CIRCULATIONAHA.105.60043716785351YusufSPittBDavisCEHoodWBJrCohnJN.Effect of enalapril on mortality and the development of heart failure in asymptomatic patients with reduced left ventricular ejection fractions.N Engl J Med. (1992) 327:685–91. 10.1056/nejm1992090332710031463530JongPYusufSRousseauMFAhnSABangdiwalaSI.Effect of Enalapril on 12-year survival and life expectancy in patients with left ventricular systolic dysfunction: a follow-up study.Lancet. (2003) 361:1843–8. 10.1016/S0140-6736(03)13501-5KøberLTorp-PedersenCCarlsenJEBaggerHEliasenPLyngborgKA clinical trial of the angiotensin-converting-enzyme inhibitor trandolapril in patients with left ventricular dysfunction after myocardial infarction. trandolapril cardiac evaluation (trace) study group.N Engl J Med. (1995) 333:1670–6. 10.1056/nejm1995122133325037477219MozaffarianDBenjaminEJGoASArnettDKBlahaMJCushmanMHeart disease and stroke statistics–2015 update: a report from the American heart association.Circulation. (2015) 131:e29–322. 10.1161/cir.000000000000015225520374PfefferMABraunwaldEMoyéLABastaLBrownEJJrCuddyTEEffect of captopril on mortality and morbidity in patients with left ventricular dysfunction after myocardial infarction. Results of the survival and ventricular enlargement trial. the save investigators.N Engl J Med. (1992) 327:669–77. 10.1056/nejm1992090332710011386652KwonJMKimKHJeonKHKimHMKimMJLimSMDevelopment and validation of deep-learning algorithm for electrocardiography-based heart failure identification.Korean Circ J. (2019) 49:629–39. 10.4070/kcj.2018.044631074221AttiaZIKapaSYaoXLopez-JimenezFMohanTLPellikkaPAProspective validation of a deep learning electrocardiogram algorithm for the detection of left ventricular systolic dysfunction.J Cardiovasc Electrophysiol. (2019) 30:668–74. 10.1111/jce.1388930821035ChoJLeeBKwonJMLeeYParkHOhBHArtificial intelligence algorithm for screening heart failure with reduced ejection fraction using electrocardiography.ASAIO J. (2021) 67:314–21. 10.1097/MAT.000000000000121833627606FinocchiaroGMerloMSheikhNDe AngelisGPapadakisMOlivottoIThe electrocardiogram in the diagnosis and management of patients with dilated cardiomyopathy.Eur J Heart Fail. (2020) 22:1097–107. 10.1002/ejhf.181532243666MerloMZaffalonDStolfoDAltinierABarbatiGZecchinMECG in dilated cardiomyopathy: specific findings and long-term prognostic significance.J Cardiovasc Med (Hagerstown). (2019) 20:450–8. 10.2459/JCM.000000000000080430985353ErdoganTDurakoglugilMECicekYCetinMDumanHSatirogluOProlonged QRS duration on surface electrocardiogram is associated with left ventricular restrictive filling pattern.Interv Med Appl Sci. (2017) 9:9–14. 10.1556/1646.9.2017.1.0528932490KashaniABaroldSS.Significance of QRS complex duration in patients with heart failure.J Am Coll Cardiol. (2005) 46:2183–92. 10.1016/j.jacc.2005.01.07116360044NableJVBradyW.The evolution of electrocardiographic changes in St-segment elevation myocardial infarction.Am J Emerg Med. (2009) 27:734–46. 10.1016/j.ajem.2008.05.02519751632StraussDGSelvesterRHLimaJAArhedenHMillerJMGerstenblithGECG quantification of myocardial scar in cardiomyopathy patients with or without conduction defects: correlation with cardiac magnetic resonance and arrhythmogenesis.Circ Arrhythm Electrophysiol. (2008) 1:327–36. 10.1161/circep.108.79866019808427AttiaZINoseworthyPALopez-JimenezFAsirvathamSJDeshmukhAJGershBJAn artificial intelligence-enabled ECG algorithm for the identification of patients with atrial fibrillation during sinus rhythm: a retrospective analysis of outcome prediction.Lancet. (2019) 394:861–7. 10.1016/s0140-6736(19)31721-0LinCChauTLinC-SShangH-SFangW-HLeeD-JPoint-of-care artificial intelligence-enabled ECG for dyskalemia: a retrospective cohort analysis for accuracy and outcome prediction.NPJ Digit Med. (2022) 5:8. 10.1038/s41746-021-00550-035046489BozkurtBCoatsAJTsutsuiHAbdelhamidMAdamopoulosSAlbertNUniversal definition and classification of heart failure: a report of the heart failure society of America, heart failure association of the European society of cardiology, Japanese heart failure society and writing committee of the universal definition of heart failure.J Card Fail. (2021). 10.1016/j.cardfail.2021.01.022[Epub ahead of print].