Dataset Information

Clinical Applications, Methodology, and Scientific Reporting of Electrocardiogram Deep-Learning Models: A Systematic Review.

ABSTRACT:

Background

The electrocardiogram (ECG) is one of the most common diagnostic tools available to assess cardio-vascular health. The advent of advanced computational techniques such as deep learning has dramatically expanded the breadth of clinical problems that can be addressed using ECG data, leading to increasing popularity of ECG deep-learning models aimed at predicting clinical endpoints.

Objectives

The purpose of this study was to define the current landscape of clinically relevant ECG deep-learning models and examine practices in the scientific reporting of these studies.

Methods

We performed a systematic review of PubMed and EMBASE databases to identify clinically relevant ECG deep-learning models published through July 1, 2022.

Results

We identified 44 manuscripts including 53 unique, clinically relevant ECG deep-learning models. The rate of publication of ECG deep-learning models is increasing rapidly. The most common clinical applications of ECG deep learning were identification of cardiomyopathy (14/53 [26%]), followed by arrhythmia detection (9/53 [17%]). Methodologic reporting varied; while 33/44 (75%) publications included model architecture diagrams, complete information required to reproduce these models was provided in only 10/44 (23%). Saliency analysis was performed in 20/44 (46%) of publications. Only 18/53 (34%) models were tested within external validation cohorts. Model code or resources allowing for model implementation by external groups were available for only 5/44 (11%) publications.

Conclusions

While ECG deep-learning models are increasingly clinically relevant, their reporting is highly variable, and few publications provide sufficient detail for methodologic reproduction or model validation by external groups. The field of ECG deep learning would benefit from adherence to a set of standardized scientific reporting guidelines.

SUBMITTER: Avula V

PROVIDER: S-EPMC10824530 | biostudies-literature | 2023 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Clinical Applications, Methodology, and Scientific Reporting of Electrocardiogram Deep-Learning Models: A Systematic Review.

Avula Vennela V Wu Katherine C KC Carrick Richard T RT

JACC. Advances 20231108 10

<h4>Background</h4>The electrocardiogram (ECG) is one of the most common diagnostic tools available to assess cardio-vascular health. The advent of advanced computational techniques such as deep learning has dramatically expanded the breadth of clinical problems that can be addressed using ECG data, leading to increasing popularity of ECG deep-learning models aimed at predicting clinical endpoints.<h4>Objectives</h4>The purpose of this study was to define the current landscape of clinically rele ...[more]

PMID: 38288263

Similar Datasets

Project description:BackgroundWhile many studies have consistently found incomplete reporting of regression-based prediction model studies, evidence is lacking for machine learning-based prediction model studies. We aim to systematically review the adherence of Machine Learning (ML)-based prediction model studies to the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) Statement.MethodsWe included articles reporting on development or external validation of a multivariable prediction model (either diagnostic or prognostic) developed using supervised ML for individualized predictions across all medical fields. We searched PubMed from 1 January 2018 to 31 December 2019. Data extraction was performed using the 22-item checklist for reporting of prediction model studies ( www.TRIPOD-statement.org ). We measured the overall adherence per article and per TRIPOD item.ResultsOur search identified 24,814 articles, of which 152 articles were included: 94 (61.8%) prognostic and 58 (38.2%) diagnostic prediction model studies. Overall, articles adhered to a median of 38.7% (IQR 31.0-46.4%) of TRIPOD items. No article fully adhered to complete reporting of the abstract and very few reported the flow of participants (3.9%, 95% CI 1.8 to 8.3), appropriate title (4.6%, 95% CI 2.2 to 9.2), blinding of predictors (4.6%, 95% CI 2.2 to 9.2), model specification (5.2%, 95% CI 2.4 to 10.8), and model's predictive performance (5.9%, 95% CI 3.1 to 10.9). There was often complete reporting of source of data (98.0%, 95% CI 94.4 to 99.3) and interpretation of the results (94.7%, 95% CI 90.0 to 97.3).ConclusionSimilar to prediction model studies developed using conventional regression-based techniques, the completeness of reporting is poor. Essential information to decide to use the model (i.e. model specification and its performance) is rarely reported. However, some items and sub-items of TRIPOD might be less suitable for ML-based prediction model studies and thus, TRIPOD requires extensions. Overall, there is an urgent need to improve the reporting quality and usability of research to avoid research waste.Systematic review registrationPROSPERO, CRD42019161764.

Dataset Information

Clinical Applications, Methodology, and Scientific Reporting of Electrocardiogram Deep-Learning Models: A Systematic Review.

Background

Objectives

Methods

Results

Conclusions

Publications

Clinical Applications, Methodology, and Scientific Reporting of Electrocardiogram Deep-Learning Models: A Systematic Review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets