Accuracy and Systematic Biases of Heart Rate Measurements by Consumer-Grade Fitness Trackers in Postoperative Patients: Prospective Clinical Trial.
Ontology highlight
ABSTRACT: Background
Over the recent years, technological advances of wrist-worn fitness trackers heralded a new era in the continuous monitoring of vital signs. So far, these devices have primarily been used for sports.Objective
However, for using these technologies in health care, further validations of the measurement accuracy in hospitalized patients are essential but lacking to date.Methods
We conducted a prospective validation study with 201 patients after moderate to major surgery in a controlled setting to benchmark the accuracy of heart rate measurements in 4 consumer-grade fitness trackers (Apple Watch 7, Garmin Fenix 6 Pro, Withings ScanWatch, and Fitbit Sense) against the clinical gold standard (electrocardiography).Results
All devices exhibited high correlation (r≥0.95; P<.001) and concordance (rc≥0.94) coefficients, with a relative error as low as mean absolute percentage error <5% based on 1630 valid measurements. We identified confounders significantly biasing the measurement accuracy, although not at clinically relevant levels (mean absolute error<5 beats per minute).Conclusions
Consumer-grade fitness trackers appear promising in hospitalized patients for monitoring heart rate.Trial registration
ClinicalTrials.gov NCT05418881; https://www.clinicaltrials.gov/ct2/show/NCT05418881.
SUBMITTER: Helmer P
PROVIDER: S-EPMC9840097 | biostudies-literature | 2022 Dec
REPOSITORIES: biostudies-literature
Publications
Accuracy and Systematic Biases of Heart Rate Measurements by Consumer-Grade Fitness Trackers in Postoperative Patients: Prospective Clinical Trial.
Helmer Philipp P Hottenrott Sebastian S Rodemers Philipp P Leppich Robert R Helwich Maja M Pryss Rüdiger R Kranke Peter P Meybohm Patrick P Winkler Bernd E BE Sammeth Michael M
Journal of medical Internet research 20221230 12
<h4>Background</h4>Over the recent years, technological advances of wrist-worn fitness trackers heralded a new era in the continuous monitoring of vital signs. So far, these devices have primarily been used for sports.<h4>Objective</h4>However, for using these technologies in health care, further validations of the measurement accuracy in hospitalized patients are essential but lacking to date.<h4>Methods</h4>We conducted a prospective validation study with 201 patients after moderate to major s ...[more]
Similar Datasets
Project description:Metabolic syndrome increases the risks of cardiovascular diseases, type 2 diabetes, and certain cancers. The early detection of metabolic syndrome is clinically relevant, as it enables timely and targeted interventions. In the current study, we aimed to investigate the association between metabolic syndrome and heart rate measured using wearable devices in a real-world setting and compare this association with that for clinical resting heart rate. Data from 564 middle-aged adults who wore wearable devices for at least 7 days with a minimum daily wear time of 20 h were analyzed. The results showed significantly elevated all-day, sleeping, minimum, and inactive heart rates in men with pre-metabolic or metabolic syndrome compared with those in normal individuals, whereas sleeping heart rate and heart rate dips were significantly increased and decreased, respectively, in women with metabolic syndrome. After adjusting for confounders, every 10-beats-per-minute increment in all-day, sleeping, minimum, and inactive heart rates in men corresponded to odds ratios of 2.80 (95% confidence interval 1.53-5.44), 3.06 (1.57-6.40), 4.21 (1.87-10.47), and 3.09 (1.64-6.29), respectively, for the presence of pre-metabolic or metabolic syndrome. In women, the association was significant only for heart rate dips (odds ratio = 0.49 [95% confidence interval 0.25-0.96] for every 10% increment). Models incorporating inactive or minimum heart rate in men and heart rate dip in women demonstrated better fits, as indicated by lower Akaike information criterion values (170.3 in men and 364.9 in women), compared with models that included clinical resting heart rate (173.4 in men and 369.1 in women). These findings suggest that the heart rate indices obtained from wearable devices may facilitate early identification of metabolic syndrome.
| S-EPMC11470009 | biostudies-literature
Project description:Wrist-worn activity trackers have experienced a tremendous growth lately and studies on the accuracy of mainstream trackers used by older adults are needed. This study explores the performance of six trackers (Fitbit Charge2, Garmin VivoSmart HR+, Philips Health Watch, Withings Pulse Ox, ActiGraph GT9X-BT, Omron HJ-72OITC) for estimating: steps, travelled distance, and heart-rate measurements for a cohort of older adults. Eighteen older adults completed a structured protocol involving walking tasks, simulated household activities, and sedentary activities. Less standardized activities were also included, such as: dusting, using a walking aid, or playing cards, in order to simulate real-life scenarios. Wrist-mounted and chest/waist-mounted devices were used. Gold-standards included treadmill, ECG-based chest strap, direct observation or video recording according to the activity and parameter. Every tracker showed a decreasing accuracy with slower walking speed, which resulted in a significant step under-counting. A large mean absolute percentage error (MAPE) was found for every monitor at slower walking speeds with the lowest reported MAPE at 2 km/h being 7.78%, increasing to 20.88% at 1.5 km/h, and 44.53% at 1 km/h. During household activities, the MAPE climbing up/down-stairs ranged from 8.38-19.3% and 10.06-19.01% (dominant and non-dominant arm), respectively. Waist-worn devices showed a more uniform performance. However, unstructured activities (e.g. dusting, playing cards), and using a walking aid represent a challenge for all wrist-worn trackers as evidenced by large MAPE (> 57.66% for dusting, > 67.32% when using a walking aid). Poor performance in travelled distance estimation was also evident during walking at low speeds and climbing up/down-stairs (MAPE > 71.44% and > 48.3%, respectively). Regarding heart-rate measurement, there was no significant difference (p-values > 0.05) in accuracy between trackers placed on the dominant or non-dominant arm. Concordant with existing literature, while the mean error was limited (between -3.57 bpm and 4.21 bpm), a single heart-rate measurement could be underestimated up to 30 beats-per-minute. This study showed a number of limitations of consumer-level wrist-based activity trackers for older adults. Therefore caution is required when used, in healthcare or in research settings, to measure activity in older adults.
| S-EPMC6529154 | biostudies-literature
Project description:BackgroundWearable fitness trackers are devices that can record and enhance physical activity among users. Recently, photoplethysmography (PPG) devices that use optical heart rate sensors to detect heart rate in real time have become popular and help in monitoring and controlling exercise intensity. Although the benefits of using optical heart rate monitors have been highlighted through studies, the accuracy of the readouts these commercial devices generate has not been widely assessed for different age groups, especially for the East Asian population with Fitzpatrick skin type III or IV.ObjectiveThis study aimed to examine the accuracy of 2 wearable fitness trackers with PPG to monitor heart rate in real time during moderate exercise in young and older adults.MethodsA total of 20 young adults and 20 older adults were recruited for this study. All participants were asked to undergo a series of sedentary and moderate physical activities using indoor aerobic exercise equipment. In this study, the Polar H7 chest-strapped heart rate monitor was used as the criterion measure in 2 fitness trackers, namely Xiaomi Mi Band 2 and Garmin Vivosmart HR+. The real-time, second-by-second heart rate data obtained from both devices were recorded using the broadcast heart rate mode. To critically analyze the results, multiple statistical parameters including the mean absolute percentage error (MAPE), Lin concordance correlation coefficient (CCC), intraclass correlation coefficient, the Pearson product moment correlation coefficient, and the Bland-Altman coefficient were determined to examine the performances of the devices.ResultsBoth test devices exhibited acceptable overall accuracy as heart rate sensors based on several statistical tests. Notably, the MAPE values were below 10% (the designated threshold) in both devices (GarminYoung=3.77%; GarminSenior=4.73%; XiaomiYoung=7.69%; and XiaomiSenior=6.04%). The scores for reliability test of CCC for Garmin were 0.92 (Young) and 0.80 (Senior), whereas those for Xiaomi were 0.76 (Young) and 0.73 (Senior). However, the results obtained using the Bland-Altman analysis indicated that both test optical devices underestimated the average heart rate. More importantly, the study documented some unexpected outlier readings reported by these devices when used on certain participants.ConclusionsThe study reveals that commonly used optical heart rate sensors, such as the ones used herein, generally produce accurate heart rate readings irrespective of the age of the user. However, users should avoid relying entirely on these readings to indicate exercise intensities, as these devices have a tendency to produce erroneous, extreme readings, which might misinterpret the real-time exercise intensity. Future studies should therefore emphasize the occurrence rate of such errors, as this will likely benefit the development of improved models of heart rate sensors.
| S-EPMC7218601 | biostudies-literature
Project description: Not available
| S-EPMC5564399 | biostudies-literature
Project description:Blood oxygen saturation is an important clinical parameter, especially in postoperative hospitalized patients, monitored in clinical practice by arterial blood gas (ABG) and/or pulse oximetry that both are not suitable for a long-term continuous monitoring of patients during the entire hospital stay, or beyond. Technological advances developed recently for consumer-grade fitness trackers could-at least in theory-help to fill in this gap, but benchmarks on the applicability and accuracy of these technologies in hospitalized patients are currently lacking. We therefore conducted at the postanaesthesia care unit under controlled settings a prospective clinical trial with 201 patients, comparing in total >1,000 oxygen blood saturation measurements by fitness trackers of three brands with the ABG gold standard and with pulse oximetry. Our results suggest that, despite of an overall still tolerable measuring accuracy, comparatively high dropout rates severely limit the possibilities of employing fitness trackers, particularly during the immediate postoperative period of hospitalized patients.
| S-EPMC10590865 | biostudies-literature
Project description:BackgroundConsumer sleep trackers (CSTs) have gained significant popularity because they enable individuals to conveniently monitor and analyze their sleep. However, limited studies have comprehensively validated the performance of widely used CSTs. Our study therefore investigated popular CSTs based on various biosignals and algorithms by assessing the agreement with polysomnography.ObjectiveThis study aimed to validate the accuracy of various types of CSTs through a comparison with in-lab polysomnography. Additionally, by including widely used CSTs and conducting a multicenter study with a large sample size, this study seeks to provide comprehensive insights into the performance and applicability of these CSTs for sleep monitoring in a hospital environment.MethodsThe study analyzed 11 commercially available CSTs, including 5 wearables (Google Pixel Watch, Galaxy Watch 5, Fitbit Sense 2, Apple Watch 8, and Oura Ring 3), 3 nearables (Withings Sleep Tracking Mat, Google Nest Hub 2, and Amazon Halo Rise), and 3 airables (SleepRoutine, SleepScore, and Pillow). The 11 CSTs were divided into 2 groups, ensuring maximum inclusion while avoiding interference between the CSTs within each group. Each group (comprising 8 CSTs) was also compared via polysomnography.ResultsThe study enrolled 75 participants from a tertiary hospital and a primary sleep-specialized clinic in Korea. Across the 2 centers, we collected a total of 3890 hours of sleep sessions based on 11 CSTs, along with 543 hours of polysomnography recordings. Each CST sleep recording covered an average of 353 hours. We analyzed a total of 349,114 epochs from the 11 CSTs compared with polysomnography, where epoch-by-epoch agreement in sleep stage classification showed substantial performance variation. More specifically, the highest macro F1 score was 0.69, while the lowest macro F1 score was 0.26. Various sleep trackers exhibited diverse performances across sleep stages, with SleepRoutine excelling in the wake and rapid eye movement stages, and wearables like Google Pixel Watch and Fitbit Sense 2 showing superiority in the deep stage. There was a distinct trend in sleep measure estimation according to the type of device. Wearables showed high proportional bias in sleep efficiency, while nearables exhibited high proportional bias in sleep latency. Subgroup analyses of sleep trackers revealed variations in macro F1 scores based on factors, such as BMI, sleep efficiency, and apnea-hypopnea index, while the differences between male and female subgroups were minimal.ConclusionsOur study showed that among the 11 CSTs examined, specific CSTs showed substantial agreement with polysomnography, indicating their potential application in sleep monitoring, while other CSTs were partially consistent with polysomnography. This study offers insights into the strengths of CSTs within the 3 different classes for individuals interested in wellness who wish to understand and proactively manage their own sleep.
| S-EPMC10654909 | biostudies-literature
Project description:BackgroundNew fitness trackers and smartwatches are released to the consumer market every year. These devices are equipped with different sensors, algorithms, and accompanying mobile apps. With recent advances in mobile sensor technology, privately collected physical activity data can be used as an addition to existing methods for health data collection in research. Furthermore, data collected from these devices have possible applications in patient diagnostics and treatment. With an increasing number of diverse brands, there is a need for an overview of device sensor support, as well as device applicability in research projects.ObjectiveThe objective of this study was to examine the availability of wrist-worn fitness wearables and analyze availability of relevant fitness sensors from 2011 to 2017. Furthermore, the study was designed to assess brand usage in research projects, compare common brands in terms of developer access to collected health data, and features to consider when deciding which brand to use in future research.MethodsWe searched for devices and brand names in six wearable device databases. For each brand, we identified additional devices on official brand websites. The search was limited to wrist-worn fitness wearables with accelerometers, for which we mapped brand, release year, and supported sensors relevant for fitness tracking. In addition, we conducted a Medical Literature Analysis and Retrieval System Online (MEDLINE) and ClinicalTrials search to determine brand usage in research projects. Finally, we investigated developer accessibility to the health data collected by identified brands.ResultsWe identified 423 unique devices from 132 different brands. Forty-seven percent of brands released only one device. Introduction of new brands peaked in 2014, and the highest number of new devices was introduced in 2015. Sensor support increased every year, and in addition to the accelerometer, a photoplethysmograph, for estimating heart rate, was the most common sensor. Out of the brands currently available, the five most often used in research projects are Fitbit, Garmin, Misfit, Apple, and Polar. Fitbit is used in twice as many validation studies as any other brands and is registered in ClinicalTrials studies 10 times as often as other brands.ConclusionsThe wearable landscape is in constant change. New devices and brands are released every year, promising improved measurements and user experience. At the same time, other brands disappear from the consumer market for various reasons. Advances in device quality offer new opportunities for research. However, only a few well-established brands are frequently used in research projects, and even less are thoroughly validated.
| S-EPMC5887043 | biostudies-literature
Project description:BackgroundCritical illness has been suggested as a sentinel event for frailty development in at-risk older adults. Frail critical illness survivors are affected by increased adverse health outcomes, but monitoring the recovery after intensive care unit (ICU) discharge is challenging. Clinicians and funders of health care systems envision an increased role of wearable devices in monitoring clinically relevant measures, as sensor technology is advancing rapidly. The use of wearable devices has also generated great interest among older patients, and they are the fastest growing group of consumer-grade wearable device users. Recent research studies indicate that consumer-grade wearable devices offer the possibility of measuring frailty.ObjectiveThis study aims to examine the data collected from wearable devices for the progression of frailty among critical illness survivors.MethodsAn observational study was conducted with 12 older survivors of critical illness from Kingston General Hospital in Canada. Frailty was measured using the Clinical Frailty Scale (CFS) at ICU admission, hospital discharge, and 4-week follow-up. A wearable device was worn between hospital discharge and 4-week follow-up. The wearable device collected data on step count, physical activity, sleep, and heart rate (HR). Patient assessments were reviewed, including the severity of illness, cognition level, delirium, activities of daily living, and comorbidity.ResultsThe CFS scores increased significantly following critical illness compared with the pre-ICU frailty level (P=.02; d=-0.53). Survivors who were frail over the 4-week follow-up period had significantly lower daily step counts than survivors who were not frail (P=.02; d=1.81). There was no difference in sleep and HR measures. Daily step count was strongly correlated with the CFS at 4-week follow-up (r=-0.72; P=.04). The average HR was strongly correlated with the CFS at hospital discharge (r=-0.72; P=.046). The HR SD was strongly correlated (r=0.78; P=.02) with the change in CFS from ICU admission to 4-week follow-up. No association was found between the CFS and sleep measures. The pattern of increasing step count over the 4-week follow-up period was correlated with worsening of frailty (r=.62; P=.03).ConclusionsThis study demonstrated an association between frailty and data generated from a consumer-grade wearable device. Daily step count and HR showed a strong association with the frailty progression of the survivors of critical illness over time. Understanding this association could unlock a new avenue for clinicians to monitor and identify a vulnerable subset of the older adult population that might benefit from an early intervention.
| S-EPMC8081159 | biostudies-literature
Project description:Measuring the fitnesses of genetic variants is a fundamental objective in evolutionary biology. A standard approach for measuring microbial fitnesses in bulk involves labeling a library of genetic variants with unique sequence barcodes, competing the labeled strains in batch culture, and using deep sequencing to track changes in the barcode abundances over time. However, idiosyncratic properties of barcodes can induce nonuniform amplification or uneven sequencing coverage that causes some barcodes to be over- or under-represented in samples. This systematic bias can result in erroneous read count trajectories and misestimates of fitness. Here, we develop a computational method, named REBAR (Removing the Effects of Bias through Analysis of Residuals), for inferring the effects of barcode processing bias by leveraging the structure of systematic deviations in the data. We illustrate this approach by applying it to two independent data sets, and demonstrate that this method estimates and corrects for bias more accurately than standard proxies, such as GC-based corrections. REBAR mitigates bias and improves fitness estimates in high-throughput assays without introducing additional complexity to the experimental protocols, with potential applications in a range of experimental evolution and mutation screening contexts.
| S-EPMC11316221 | biostudies-literature
Project description:BackgroundStress can have adverse effects on health and well-being. Informed by laboratory findings that heart rate variability (HRV) decreases in response to an induced stress response, recent efforts to monitor perceived stress in the wild have focused on HRV measured using wearable devices. However, it is not clear that the well-established association between perceived stress and HRV replicates in naturalistic settings without explicit stress inductions and research-grade sensors.ObjectiveThis study aims to quantify the strength of the associations between HRV and perceived daily stress using wearable devices in real-world settings.MethodsIn the main study, 657 participants wore a fitness tracker and completed 14,695 ecological momentary assessments (EMAs) assessing perceived stress, anxiety, positive affect, and negative affect across 8 weeks. In the follow-up study, approximately a year later, 49.8% (327/657) of the same participants wore the same fitness tracker and completed 1373 EMAs assessing perceived stress at the most stressful time of the day over a 1-week period. We used mixed-effects generalized linear models to predict EMA responses from HRV features calculated over varying time windows from 5 minutes to 24 hours.ResultsAcross all time windows, the models explained an average of 1% (SD 0.5%; marginal R2) of the variance. Models using HRV features computed from an 8 AM to 6 PM time window (namely work hours) outperformed other time windows using HRV features calculated closer to the survey response time but still explained a small amount (2.2%) of the variance. HRV features that were associated with perceived stress were the low frequency to high frequency ratio, very low frequency power, triangular index, and SD of the averages of normal-to-normal intervals. In addition, we found that although HRV was also predictive of other related measures, namely, anxiety, negative affect, and positive affect, it was a significant predictor of stress after controlling for these other constructs. In the follow-up study, calculating HRV when participants reported their most stressful time of the day was less predictive and provided a worse fit (R2=0.022) than the work hours time window (R2=0.032).ConclusionsA significant but small relationship between perceived stress and HRV was found. Thus, although HRV is associated with perceived stress in laboratory settings, the strength of that association diminishes in real-life settings. HRV might be more reflective of perceived stress in the presence of specific and isolated stressors and research-grade sensing. Relying on wearable-derived HRV alone might not be sufficient to detect stress in naturalistic settings and should not be considered a proxy for perceived stress but rather a component of a complex phenomenon.
| S-EPMC9389384 | biostudies-literature