Dataset Information

Predicting Six-Month Re-Admission Risk in Heart Failure Patients Using Multiple Machine Learning Methods: A Study Based on the Chinese Heart Failure Population Database.

ABSTRACT: Since most patients with heart failure are re-admitted to the hospital, accurately identifying the risk of re-admission of patients with heart failure is important for clinical decision making and management. This study plans to develop an interpretable predictive model based on a Chinese population for predicting six-month re-admission rates in heart failure patients. Research data were obtained from the PhysioNet portal. To ensure robustness, we used three approaches for variable selection. Six different machine learning models were estimated based on selected variables. The ROC curve, prediction accuracy, sensitivity, and specificity were used to evaluate the performance of the established models. In addition, we visualized the optimized model with a nomogram. In all, 2002 patients with heart failure were included in this study. Of these, 773 patients experienced re-admission and a six-month re-admission incidence of 38.61%. Based on evaluation metrics, the logistic regression model performed best in the validation cohort, with an AUC of 0.634 (95%CI: 0.599-0.646) and an accuracy of 0.652. A nomogram was also generated. The established prediction model has good discrimination ability in predicting. Our findings are helpful and could provide useful information for the allocation of healthcare resources and for improving the quality of survival of heart failure patients.

SUBMITTER: Chen S

PROVIDER: S-EPMC9918116 | biostudies-literature | 2023 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Predicting Six-Month Re-Admission Risk in Heart Failure Patients Using Multiple Machine Learning Methods: A Study Based on the Chinese Heart Failure Population Database.

Chen Shiyu S Hu Weiwei W Yang Yuhui Y Cai Jiaxin J Luo Yaqi Y Gong Lingmin L Li Yemian Y Si Aima A Zhang Yuxiang Y Liu Sitong S Mi Baibing B Pei Leilei L Zhao Yaling Y Chen Fangyao F

Journal of clinical medicine 20230121 3

Since most patients with heart failure are re-admitted to the hospital, accurately identifying the risk of re-admission of patients with heart failure is important for clinical decision making and management. This study plans to develop an interpretable predictive model based on a Chinese population for predicting six-month re-admission rates in heart failure patients. Research data were obtained from the PhysioNet portal. To ensure robustness, we used three approaches for variable selection. Si ...[more]

PMID: 36769515

Similar Datasets

Project description:BackgroundDigital tools may support people to self-manage their heart failure (HF). Having previously outlined the human-centered design development of a digital tool to support self-care of HF, the next step was to pilot the tool over a period of time to establish people's acceptance of it in practice.ObjectiveThis study aims to conduct an observational pilot study to examine the usability, adherence, and feasibility of a digital health tool for HF within the Irish health care system.MethodsA total of 19 participants with HF were provided with a digital tool comprising a mobile app and the Fitbit Charge 4 and Aria Air smart scales for a period of 6 months. Changes to their self-care were assessed before and after the study with the 9-item European HF Self-care Behavior Scale (EHFScBS) and the Minnesota Living with HF Questionnaire (MLwHFQ) using a Wilcoxon signed rank test. After the study, 3 usability questionnaires were implemented and descriptively analyzed: the System Usability Scale (SUS), Wearable Technology Motivation Scale (WTMS), and Comfort Rating Scale (CRS). Participants also undertook a semistructured interview regarding their experiences with the digital tool. Interviews were analyzed deductively using the Theoretical Domains Framework.ResultsParticipants wore their devices for an average of 86.2% of the days in the 6-month testing period ranging from 40.6% to 98%. Although improvements in the EHFScBS and MLwHFQ were seen, these changes were not significant (P=.10 and P=.70, respectively, where P>.03, after a Bonferroni correction). SUS results suggest that the usability of this system was not acceptable with a median score of 58.8 (IQR 55.0-60.0; range 45.0-67.5). Participants demonstrated a strong motivation to use the system according to the WTMS (median 6.0, IQR 5.0-7.0; range 1.0-7.0), whereas the Fitbit was considered very comfortable as demonstrated by the low CRS results (median 0.0, IQR 0.0-0.0; range 0.0-2.0). According to participant interviews, the digital tool supported self-management through increased knowledge, improved awareness, decision-making, and confidence in their own data, and improving their social support through a feeling of comfort in being watched.ConclusionsThe digital health tool demonstrated high levels of adherence and acceptance among participants. Although the SUS results suggest low usability, this may be explained by participants uncertainty that they were using it fully, rather than it being unusable, especially given the experiences documented in their interviews. The digital tool targeted key self-management behaviors and feelings of social support. However, a number of changes to the tool, and the health service, are required before it can be implemented at scale. A full-scale feasibility trial conducted at a wider level is required to fully determine its potential effectiveness and wider implementation needs.

Project description:Background: Development of advanced heart failure (HF) symptoms is the most common adverse pathway in hypertrophic cardiomyopathy (HCM) patients. Currently, there is a limited ability to identify HCM patients at risk of HF. Objectives: In this study, we present a machine learning (ML)-based model to identify individual HCM patients who are at high risk of developing advanced HF symptoms. Methods: From a consecutive cohort of HCM patients evaluated at the Tufts HCM Institute from 2001 to 2018, we extracted a set of 64 potential risk factors measured at baseline. Only patients with New York Heart Association (NYHA) functional class I/II and LV ejection fraction (LVEF) by echocardiography >35% were included. The study cohort (n = 1,427 patients) was split into three disjoint subsets: development (50%), model selection (10%), and independent validation (40%). The least absolute shrinkage and selection operator was used to select the most influential clinical variables. An ensemble of ML classifiers, including logistic regression, was used to identify patients with high risk of developing a HF outcome. Study outcomes were defined as progression to NYHA class III/IV, drop in LVEF below 35%, septal reduction procedure, and/or heart transplantation. Results: During a mean follow-up of 4.7 ± 3.7 years, advanced HF occurred in 283 (20% out of 1,427) patients. The model features included patients' sex, NYHA class (I or II), HCM type (i.e., obstructive or not), LV wall thickness, LVEF, presence of HF symptoms (e.g., dyspnea, presyncope), comorbidities (atrial fibrillation, hypertension, mitral regurgitation, and systolic anterior motion), and type of cardiac medications. The developed risk stratification model showed strong differentiation power to identify patients at advanced HF risk in the testing dataset (c-statistics = 0.81; 95% confidence interval [CI]: 0.76, 0.86). The model allowed correct identification of high-risk patients with accuracy 74% (CI: 0.70, 0.78), sensitivity 80% (CI: 0.77, 0.83), and specificity 72% (CI: 0.68, 0.76). The model performance was comparable among different sex and age groups. Conclusions: A 5-year risk prediction of progressive HF in HCM patients can be accurately estimated using ML analysis of patients' clinical and imaging parameters. A set of 17 clinical and imaging variables were identified as the most important predictors of progressive HF in HCM.

Project description:AimsThe development of acute heart failure (AHF) is a critical decision point in the natural history of the disease and carries a dismal prognosis. The lack of appropriate risk-stratification tools at hospital discharge of AHF patients significantly limits clinical ability to precisely tailor patient-specific therapeutic regimen at this pivotal juncture. Machine learning-based strategies may improve risk stratification by incorporating analysis of high-dimensional patient data with multiple covariates and novel prediction methodologies. In the current study, we aimed at evaluating the drivers for success in prediction models and establishing an institute-tailored artificial Intelligence-based prediction model for real-time decision support.Methods and resultsWe used a cohort of all 10 868 patients AHF patients admitted to a tertiary hospital during a 12 years period. A total of 372 covariates were collected from admission to the end of the hospitalization. We assessed model performance across two axes: (i) type of prediction method and (ii) type and number of covariates. The primary outcome was 1-year survival from hospital discharge. For the model-type axis, we experimented with seven different methods: logistic regression (LR) with either L1 or L2 regularization, random forest (RF), Cox proportional hazards model (Cox), extreme gradient boosting (XGBoost), a deep neural-net (NeuralNet) and an ensemble classifier of all the above methods. We were able to achieve an area under receiver operator curve (AUROC) prediction accuracy of more than 80% with most prediction models including L1/L2-LR (80.4%/80.3%), Cox (80.2%), XGBoost (80.5%), NeuralNet (80.4%). RF was inferior to other methods (78.8%), and the ensemble model was slightly superior (81.2%). The number of covariates was a significant modifier (P < 0.001) of prediction success, the use of multiplex-covariates preformed significantly better (AUROC 80.4% for L1-LR) compared with a set of known clinical covariates (AUROC 77.8%). Demographics followed by lab-tests and administrative data resulted in the largest gain in model performance.ConclusionsThe choice of the predictive modelling method is secondary to the multiplicity and type of covariates for predicting AHF prognosis. The application of a structured data pre-processing combined with the use of multiple-covariates results in an accurate, institute-tailored risk prediction in AHF.

Project description:BackgroundThe age of onset and causes of heart failure differ between high-income and low-and-middle-income countries (LMIC). Heart failure patients in LMIC also experience a higher mortality rate. Innovative ways that can risk stratify heart failure patients in this region are needed. The aim of this study was to demonstrate the utility of machine learning in predicting all-cause mortality in heart failure patients hospitalised in a tertiary academic centre.MethodsSix supervised machine learning algorithms were trained to predict in-hospital all-cause mortality using data from 500 consecutive heart failure patients with a left ventricular ejection fraction (LVEF) less than 50%.ResultsThe mean age was 55.2 ± 16.8 years. There were 271 (54.2%) males, and the mean LVEF was 29 ± 9.2%. The median duration of hospitalisation was 7 days (interquartile range: 4-11), and it did not differ between patients discharged alive and those who died. After a prediction window of 4 years (interquartile range: 2-6), 84 (16.8%) patients died before discharge from the hospital. The area under the receiver operating characteristic curve was 0.82, 0.78, 0.77, 0.76, 0.75, and 0.62 for random forest, logistic regression, support vector machines (SVM), extreme gradient boosting, multilayer perceptron (MLP), and decision trees, and the accuracy during the test phase was 88, 87, 86, 82, 78, and 76% for random forest, MLP, SVM, extreme gradient boosting, decision trees, and logistic regression. The support vector machines were the best performing algorithm, and furosemide, beta-blockers, spironolactone, early diastolic murmur, and a parasternal heave had a positive coefficient with the target feature, whereas coronary artery disease, potassium, oedema grade, ischaemic cardiomyopathy, and right bundle branch block on electrocardiogram had negative coefficients.ConclusionDespite a small sample size, supervised machine learning algorithms successfully predicted all-cause mortality with modest accuracy. The SVM model will be externally validated using data from multiple cardiology centres in South Africa before developing a uniquely African risk prediction tool that can potentially transform heart failure management through precision medicine.

Project description:AimsThis study aimed to review the performance of machine learning (ML) methods compared with conventional statistical models (CSMs) for predicting readmission and mortality in patients with heart failure (HF) and to present an approach to formally evaluate the quality of studies using ML algorithms for prediction modelling.Methods and resultsFollowing Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines, we performed a systematic literature search using MEDLINE, EPUB, Cochrane CENTRAL, EMBASE, INSPEC, ACM Library, and Web of Science. Eligible studies included primary research articles published between January 2000 and July 2020 comparing ML and CSMs in mortality and readmission prognosis of initially hospitalized HF patients. Data were extracted and analysed by two independent reviewers. A modified CHARMS checklist was developed in consultation with ML and biostatistics experts for quality assessment and was utilized to evaluate studies for risk of bias. Of 4322 articles identified and screened by two independent reviewers, 172 were deemed eligible for a full-text review. The final set comprised 20 articles and 686 842 patients. ML methods included random forests (n = 11), decision trees (n = 5), regression trees (n = 3), support vector machines (n = 9), neural networks (n = 12), and Bayesian techniques (n = 3). CSMs included logistic regression (n = 16), Cox regression (n = 3), or Poisson regression (n = 3). In 15 studies, readmission was examined at multiple time points ranging from 30 to 180 day readmission, with the majority of studies (n = 12) presenting prediction models for 30 day readmission outcomes. Of a total of 21 time-point comparisons, ML-derived c-indices were higher than CSM-derived c-indices in 16 of the 21 comparisons. In seven studies, mortality was examined at 9 time points ranging from in-hospital mortality to 1 year survival; of these nine, seven reported higher c-indices using ML. Two of these seven studies reported survival analyses utilizing random survival forests in their ML prediction models. Both reported higher c-indices when using ML compared with CSMs. A limitation of studies using ML techniques was that the majority were not externally validated, and calibration was rarely assessed. In the only study that was externally validated in a separate dataset, ML was superior to CSMs (c-indices 0.913 vs. 0.835).ConclusionsML algorithms had better discrimination than CSMs in most studies aiming to predict risk of readmission and mortality in HF patients. Based on our review, there is a need for external validation of ML-based studies of prediction modelling. We suggest that ML-based studies should also be evaluated using clinical quality standards for prognosis research. Registration: PROSPERO CRD42020134867.

Project description:BackgroundHeart failure is a cardiovascular disorder, while sepsis is a common non-cardiac cause of mortality. Patients with combined heart failure and sepsis have a significantly higher mortality rate and poor prognosis, making early identification of high-risk patients and appropriate allocation of medical resources critically important.MethodsWe constructed a survival prediction model for patients with heart failure and sepsis using the eICU-CRD database and externally validated it using the MIMIC-IV database. Our primary outcome is the 28-day all-cause mortality rate. The Boruta method is used for initial feature selection, followed by feature ranking using the XGBoost algorithm. Four machine learning models were compared, including Logistic Regression (LR), eXtreme Gradient Boosting (XGBoost), Adaptive Boosting (AdaBoost), and Gaussian Naive Bayes (GNB). Model performance was assessed using metrics such as area under the curve (AUC), accuracy, sensitivity, and specificity, and the SHAP method was utilized to visualize feature importance and interpret model results. Additionally, we conducted external validation using the MIMIC-IV database.ResultsWe developed a survival prediction model for heart failure complicated by sepsis using data from 3891 patients in the eICU-CRD and validated it externally with 2928 patients from the MIMIC-IV database. The LR model outperformed all other machine learning algorithms with a validation set AUC of 0.746 (XGBoost: 0.726, AdaBoost: 0.744, GNB: 0.722), alongside accuracy (0.685), sensitivity (0.666), and specificity (0.712). The final model incorporates 10 features: age, ventilation, norepinephrine, white blood cell count, total bilirubin, temperature, phenylephrine, respiratory rate, neutrophil count, and systolic blood pressure. We employed the SHAP method to enhance the interpretability of the model based on the LR algorithm. Additionally, external validation was conducted using the MIMIC-IV database, with an external validation AUC of 0.699.ConclusionBased on the LR algorithm, a model was constructed to effectively predict the 28-day all-cause mortality rate in patients with heart failure complicated by sepsis. Utilizing our model predictions, clinicians can promptly identify high-risk patients and receive guidance for clinical practice.

Dataset Information

Predicting Six-Month Re-Admission Risk in Heart Failure Patients Using Multiple Machine Learning Methods: A Study Based on the Chinese Heart Failure Population Database.

Publications

Predicting Six-Month Re-Admission Risk in Heart Failure Patients Using Multiple Machine Learning Methods: A Study Based on the Chinese Heart Failure Population Database.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets