Dataset Information

Predicting Mortality Using Machine Learning Algorithms in Patients Who Require Renal Replacement Therapy in the Critical Care Unit.

ABSTRACT:

Background

General severity of illness scores are not well calibrated to predict mortality among patients receiving renal replacement therapy (RRT) for acute kidney injury (AKI). We developed machine learning models to make mortality prediction and compared their performance to that of the Sequential Organ Failure Assessment (SOFA) and HEpatic failure, LactatE, NorepInephrine, medical Condition, and Creatinine (HELENICC) scores.

Methods

We extracted routinely collected clinical data for AKI patients requiring RRT in the MIMIC and eICU databases. The development models were trained in 80% of the pooled dataset and tested in the rest of the pooled dataset. We compared the area under the receiver operating characteristic curves (AUCs) of four machine learning models (multilayer perceptron [MLP], logistic regression, XGBoost, and random forest [RF]) to that of the SOFA, nonrenal SOFA, and HELENICC scores and assessed calibration, sensitivity, specificity, positive (PPV) and negative (NPV) predicted values, and accuracy.

Results

The mortality AUC of machine learning models was highest for XGBoost (0.823; 95% confidence interval [CI], 0.791-0.854) in the testing dataset, and it had the highest accuracy (0.758). The XGBoost model showed no evidence of lack of fit with the Hosmer-Lemeshow test (p > 0.05).

Conclusion

XGBoost provided the highest performance of mortality prediction for patients with AKI requiring RRT compared with previous scoring systems.

SUBMITTER: Chang HH

PROVIDER: S-EPMC9500742 | biostudies-literature | 2022 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Predicting Mortality Using Machine Learning Algorithms in Patients Who Require Renal Replacement Therapy in the Critical Care Unit.

Chang Hsin-Hsiung HH Chiang Jung-Hsien JH Wang Chi-Shiang CS Chiu Ping-Fang PF Abdel-Kader Khaled K Chen Huiwen H Siew Edward D ED Yabes Jonathan J Murugan Raghavan R Clermont Gilles G Palevsky Paul M PM Jhamb Manisha M

Journal of clinical medicine 20220908 18

Background: General severity of illness scores are not well calibrated to predict mortality among patients receiving renal replacement therapy (RRT) for acute kidney injury (AKI). We developed machine learning models to make mortality prediction and compared their performance to that of the Sequential Organ Failure Assessment (SOFA) and HEpatic failure, LactatE, NorepInephrine, medical Condition, and Creatinine (HELENICC) scores. Methods: We extracted routinely collected clinical data for AKI pa ...[more]

PMID: 36142936

Similar Datasets

Project description:BackgroundCOVID-19 has strained healthcare resources, necessitating efficient prognostication to triage patients effectively. This study quantified COVID-19 risk factors and predicted COVID-19 intensive care unit (ICU) mortality in South Africa based on machine learning algorithms.MethodsData for this study were obtained from 392 COVID-19 ICU patients enrolled between 26 March 2020 and 10 February 2021. We used an artificial neural network (ANN) and random forest (RF) to predict mortality among ICU patients and a semi-parametric logistic regression with nine covariates, including a grouping variable based on K-means clustering. Further evaluation of the algorithms was performed using sensitivity, accuracy, specificity, and Cohen's K statistics.ResultsFrom the semi-parametric logistic regression and ANN variable importance, age, gender, cluster, presence of severe symptoms, being on the ventilator, and comorbidities of asthma significantly contributed to ICU death. In particular, the odds of mortality were six times higher among asthmatic patients than non-asthmatic patients. In univariable and multivariate regression, advanced age, PF1 and 2, FiO2, severe symptoms, asthma, oxygen saturation, and cluster 4 were strongly predictive of mortality. The RF model revealed that intubation status, age, cluster, diabetes, and hypertension were the top five significant predictors of mortality. The ANN performed well with an accuracy of 71%, a precision of 83%, an F1 score of 100%, Matthew's correlation coefficient (MCC) score of 100%, and a recall of 88%. In addition, Cohen's k-value of 0.75 verified the most extreme discriminative power of the ANN. In comparison, the RF model provided a 76% recall, an 87% precision, and a 65% MCC.ConclusionBased on the findings, we can conclude that both ANN and RF can predict COVID-19 mortality in the ICU with accuracy. The proposed models accurately predict the prognosis of COVID-19 patients after diagnosis. The models can be used to prioritize COVID-19 patients with a high mortality risk in resource-constrained ICUs.

Project description:BackgroundTo construct and evaluate a predictive model for in-hospital mortality among critically ill patients with acute kidney injury (AKI) undergoing continuous renal replacement therapy (CRRT), based on nine machine learning (ML) algorithm.MethodsThe study retrospectively included patients with AKI who underwent CRRT during their initial hospitalization in the United States using the medical information mart for intensive care (MIMIC) database IV (version 2.0), as well as in the intensive care unit (ICU) of Huzhou Central Hospital. Patients from the MIMIC database were used as the training cohort to construct the models (from 2008 to 2019, n = 1068). Patients from Huzhou Central Hospital were utilized as the external validation cohort to evaluate the models (from June 2019 to December 2022, n = 327). In the training cohort, least absolute shrinkage and selection operator (LASSO) regression with cross-validation was employed to select features for constructing the model and subsequently established nine ML predictive models. The performance of these nine models on the external validation cohort dataset was comprehensively evaluated based on the area under the receiver operating characteristic curve (AUROC) and the optimal model was selected. A static nomogram and a web-based dynamic nomogram were presented, with a comprehensive evaluation from the perspectives of discrimination (AUROC), calibration (calibration curve) and clinical practicability (DCA curves).ResultsFinally, 1395 eligible patients were enrolled, including 1068 patients in the training cohort and 327 patients in the external validation cohort. In the training cohort, LASSO regression with cross-validation was employed to select features and nine models were individually constructed. Compared to the other eight models, the Lasso regularized logistic regression (Lasso-LR) model exhibited the highest AUROC (0.756) and the optimal calibration curve. The DCA curve suggested a certain clinical utility in predicting in-hospital mortality among critically ill patients with AKI undergoing CRRT. Consequently, the Lasso-LR model was the optimal model and it was visualized as a common nomogram (static nomogram) and a web-based dynamic nomogram (https://chsyh2006.shinyapps.io/dynnomapp/). Discrimination, calibration and DCA curves were employed to assess the performance of the nomogram. The AUROC for the training and external validation cohorts in the nomogram model was 0.771 (95%CI: 0.743, 0.799) and 0.756 (95%CI: 0.702, 0.809), respectively. The calibration slope and Brier score for the training cohort were 1.000 and 0.195, while for the external validation cohort, they were 0.849 and 0.197, respectively. The DCA indicated that the model had a certain clinical application value.ConclusionsOur study selected the optimal model and visualized it as a static and dynamic nomogram integrating clinical predictors, so that clinicians can personalized predict the in-hospital outcome of critically ill patients with AKI undergoing CRRT upon ICU admission.

Project description:Hyperkalemia is associated with increased risks of mortality and adverse clinical outcomes. The treatment of hyperkalemia often leads to the discontinuation or restriction of beneficial but potassium-increasing therapy such as renin-angiotensin-aldosterone inhibitors (RAASi) and high-potassium diet including fruits and vegetables. To date, limited evidence is available for personalized risk evaluation in this heterogeneous and multifactorial pathophysiological condition. We developed risk prediction models using extreme gradient boosting (XGB), multiple logistic regression (LR), and deep neural network. Models were derived from a retrospective cohort of hyperkalemic patients with either heart failure or chronic kidney disease stage ≥3a from a Japanese nationwide database (1 April 2008-30 September 2018). Studied outcomes included all-cause death, renal replacement therapy introduction (RRT), hospitalization for heart failure (HHF), and cardiovascular events within three years after hyperkalemic episodes. The best performing model was further validated using an external cohort. A total of 24,949 adult hyperkalemic patients were selected for model derivation and internal validation. A total of 1452 deaths (16.6%), 887 RRT (10.1%), 1,345 HHF (15.4%), and 621 cardiovascular events (7.1%) were observed. XGB outperformed other models. The area under receiver operator characteristic curves (AUROCs) of XGB vs. LR (95% CIs) for death, RRT, HHF, and cardiovascular events were 0.823 (0.805-0.841) vs. 0.809 (0.791-0.828), 0.957 (0.947-0.967) vs. 0.947 (0.936-0.959), 0.863 (0.846-0.880) vs. 0.838 (0.820-0.856), and 0.809 (0.784-0.834) vs. 0.798 (0.772-0.823), respectively. In the external dataset including 86,279 patients, AUROCs (95% CIs) for XGB were: death, 0.747 (0.742-0.753); RRT, 0.888 (0.882-0.894); HHF, 0.673 (0.666-0.679); and cardiovascular events, 0.585 (0.578-0.591). Kaplan-Meier curves of the high-risk predicted group showed a statistically significant difference from that of the low-risk predicted groups for all outcomes (p < 0.005; log-rank test). These findings suggest possible use of machine learning models for real-world risk assessment as a guide for observation and/or treatment decision making that may potentially lead to improved outcomes in hyperkalemic patients while retaining the benefit of life-saving therapies.

Dataset Information

Predicting Mortality Using Machine Learning Algorithms in Patients Who Require Renal Replacement Therapy in the Critical Care Unit.

Background

Methods

Results

Conclusion

Publications

Predicting Mortality Using Machine Learning Algorithms in Patients Who Require Renal Replacement Therapy in the Critical Care Unit.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets