Dataset Information

Validation of a Deep Learning Algorithm for Continuous, Real-Time Detection of Atrial Fibrillation Using a Wrist-Worn Device in an Ambulatory Environment.

ABSTRACT:

Background

Wearable devices may be useful for identification, quantification and characterization, and management of atrial fibrillation (AF). To date, consumer wrist-worn devices for AF detection using photoplethysmography-based algorithms perform only periodic checks when the user is stationary and are US Food and Drug Administration cleared for prediagnostic uses without intended use for clinical decision-making. There is an unmet need for medical-grade diagnostic wrist-worn devices that provide long-term, continuous AF monitoring.

Methods and results

We evaluated the performance of a wrist-worn device with lead-I ECG and continuous photoplethysmography (Verily Study Watch) and photoplethysmography-based convolutional neural network for AF detection and burden estimation in a prospective multicenter study that enrolled 117 patients with paroxysmal AF. A 14-day continuous ECG monitor (Zio XT) served as the reference device to evaluate algorithm sensitivity and specificity for detection of AF in 15-minute intervals. A total of 91 857 intervals were contributed by 111 subjects with evaluable reference and test data (18.3 h/d median watch wear time). The watch was 96.1% sensitive (95% CI, 92.7%-98.0%) and 98.1% specific (95% CI, 97.2%-99.1%) for interval-level AF detection. Photoplethysmography-derived AF burden estimation was highly correlated with the reference device burden (R²=0.986) with a mean difference of 0.8% (95% limits of agreement, -6.6% to 8.2%).

Conclusions

Continuous monitoring using a photoplethysmography-based convolutional neural network incorporated in a wrist-worn device has clinical-grade performance for AF detection and burden estimation. These findings suggest that monitoring can be performed with wrist-worn wearables for diagnosis and clinical management of AF.

Registration information

URL: https://www.clinicaltrials.gov; Unique identifier: NCT04546763.

SUBMITTER: Poh MZ

PROVIDER: S-EPMC10727259 | biostudies-literature | 2023 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Validation of a Deep Learning Algorithm for Continuous, Real-Time Detection of Atrial Fibrillation Using a Wrist-Worn Device in an Ambulatory Environment.

Poh Ming-Zher MZ Battisti Anthony J AJ Cheng Li-Fang LF Lin Janice J Patwardhan Anil A Venkataraman Ganesh S GS Athill Charles A CA Patel Nimesh S NS Patel Chinmay P CP Machado Christian E CE Ellis Jeffrey T JT Crosson Lori A LA Tamura Yuriko Y Plowman R Scooter RS Turakhia Mintu P MP Ghanbari Hamid H

Journal of the American Heart Association 20230926 19

<h4>Background</h4>Wearable devices may be useful for identification, quantification and characterization, and management of atrial fibrillation (AF). To date, consumer wrist-worn devices for AF detection using photoplethysmography-based algorithms perform only periodic checks when the user is stationary and are US Food and Drug Administration cleared for prediagnostic uses without intended use for clinical decision-making. There is an unmet need for medical-grade diagnostic wrist-worn devices t ...[more]

PMID: 37750558

Similar Datasets

Project description:IntroductionThough wrist-worn photoplethysmography (PPG) sensors play an important role in long-term and continuous heart rhythm monitoring, signals measured at the wrist are contaminated by more intense motion artifacts compared to other body locations. Machine learning (ML)-based algorithms can improve long-term pulse rate (PR) tracking but are associated with more stringent regulatory requirements when intended for clinical use. This study aimed to evaluate the accuracy of a digital health technology using wrist-worn PPG sensors and an ML-based algorithm to measure PR continuously.MethodsVolunteers were enrolled in three independent clinical trials and concurrently monitored with the investigational device and FDA-cleared electrocardiography (ECG) devices during supervised protocols representative of real-life activities. The primary acceptance threshold was an accuracy root-mean-square (ARMS) ≤3 beats per minute (bpm) or 5 bpm under no-motion and motion conditions, respectively. Bias, mean absolute error (MAE), mean absolute percentage error (MAPE), limits of agreement (LoA), and Pearson and Lin's concordance correlation coefficients (⍴ and CCC) were also computed. Subgroup and outlier analyses were conducted to examine the effect of site, skin tone, age, sex, body mass index (BMI), and health status on PR accuracy.ResultsCollectively, 16,915 paired observations between the device and the reference ECG were analyzed from 157 subjects (male: 49.04%, age mean: 43 years, age range: 19-83 years, BMI mean: 26.4, BMI range: 17.5-52, Fitzpatrick class V-IV: 22.9%, cardiovascular condition: 24%). The PR output attained an accuracy of 1.67 bpm under no-motion (n = 5,621 min) and 4.39 bpm under motion (n = 11,294 min), satisfying the acceptance thresholds. Bias and LoA (lower, upper LoA) were -0.09 (-3.36, 3.17) bpm under no-motion and 0.51 (-8.05, 9.06) bpm under motion. MAE was 0.6 bpm in no-motion and 1.77 bpm in motion, and MAPE was 0.86% in no-motion and 2.05% in motion, with ⍴ and CCC >0.98 in both conditions. ARMS values met the clinical acceptance threshold in all relevant subgroups at each clinical site separately, excluding male subjects under motion conditions (ARMS = 5.41 bpm), with more frequent and larger outliers due to stronger forearm contractions. However, these mostly occurred in isolation and, therefore would not impact the clinical utility or usability of the device for its intended use of retrospective review and trend analysis (⍴ and CCC >0.97 and MAPE = 2.61%).ConclusionThe analytical validation conducted in this study demonstrated clinical-grade accuracy and generalizability of ML-based continuous PR estimations across a full range of physical motions, health conditions, and demographic variables known to confound PPG signals, paving the way for device usage by populations most likely to benefit from continuous PR monitoring.

Project description:BackgroundSmartwatches are commonly capable to record a lead-I-like electrocardiogram (ECG) and perform a photoplethysmography (PPG)-based atrial fibrillation (AF) detection. Wearable technologies repeatedly face the challenge of frequent premature beats, particularly in target populations for screening of AF.ObjectiveTo investigate the potential diagnostic benefit of six-lead ECG compared to single-lead ECG and PPG-based algorithm for AF detection of the wrist-worn device.Methods and resultsFrom the database of DoubleCheck-AF 249 adults were enrolled in AF group (n = 121) or control group of SR with frequent premature ventricular (PVCs) or atrial (PACs) contractions (n = 128). Cardiac rhythm was monitored using a wrist-worn device capable of recording continuous PPG and simultaneous intermittent six-lead standard-limb-like ECG. To display a single-lead ECG, the six-lead ECGs were trimmed to lead-I-like ECGs. Two diagnosis-blinded cardiologists evaluated reference, six-lead and single-lead ECGs as "AF", "SR", or "Cannot be concluded". AF detection based on six-lead ECG, single-lead ECG, and PPG yielded a sensitivity of 99.2%, 95.7%, and 94.2%, respectively. The higher number of premature beats per minute was associated with false positive outcomes of single-lead ECG (18.80 vs. 5.40 beats/min, P < 0.01), six-lead ECG (64.3 vs. 5.8 beats/min, P = 0.018), and PPG-based detector (13.20 vs. 5.60 beats/min, P = 0.05). Single-lead ECG required 3.4 times fewer extrasystoles than six-lead ECG to result in a false positive outcome. In a control subgroup of PACs, the specificity of six-lead ECG, single-lead ECG, and PPG dropped to 95%, 83.8%, and 90%, respectively. The diagnostic value of single-lead ECG (AUC 0.898) was inferior to six-lead ECG (AUC 0.971) and PPG-based detector (AUC 0.921). In a control subgroup of PVCs, the specificity of six-lead ECG, single-lead ECG, and PPG was 100%, 96.4%, and 96.6%, respectively. The diagnostic value of single-lead ECG (AUC 0.961) was inferior to six-lead ECG (AUC 0.996) and non-inferior to PPG-based detector (AUC 0.954).ConclusionsA six-lead wearable-recorded ECG demonstrated the superior diagnostic value of AF detection compared to a single-lead ECG and PPG-based AF detection. The risk of type I error due to the widespread use of smartwatch-enabled single-lead ECGs in populations with frequent premature beats is significant.

Dataset Information

Validation of a Deep Learning Algorithm for Continuous, Real-Time Detection of Atrial Fibrillation Using a Wrist-Worn Device in an Ambulatory Environment.

Background

Methods and results

Conclusions

Registration information

Publications

Validation of a Deep Learning Algorithm for Continuous, Real-Time Detection of Atrial Fibrillation Using a Wrist-Worn Device in an Ambulatory Environment.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets