Dataset Information

Machine learning-based prediction model for postoperative delirium in non-cardiac surgery.

ABSTRACT:

Background

Postoperative delirium is a common complication that is distressing. This study aimed to demonstrate a prediction model for delirium.

Methods

Among 203,374undergoing non-cardiac surgery between January 2011 and June 2019 at Samsung Medical Center, 2,865 (1.4%) were diagnosed with postoperative delirium. After comparing performances of machine learning algorithms, we chose variables for a prediction model based on an extreme gradient boosting algorithm. Using the top five variables, we generated a prediction model for delirium and conducted an external validation. The Kaplan-Meier and Cox survival analyses were used to analyse the difference of delirium occurrence in patients classified as a prediction model.

Results

The top five variables selected for the postoperative delirium prediction model were age, operation duration, physical status classification, male sex, and surgical risk. An optimal probability threshold in this model was estimated to be 0.02. The area under the receiver operating characteristic (AUROC) curve was 0.870 with a 95% confidence interval of 0.855-0.885, and the sensitivity and specificity of the model were 0.76 and 0.84, respectively. In an external validation, the AUROC was 0.867 (0.845-0.877). In the survival analysis, delirium occurred more frequently in the group of patients predicted as delirium using an internal validation dataset (p < 0.001).

Conclusion

Based on machine learning techniques, we analyzed a prediction model of delirium in patients who underwent non-cardiac surgery. Screening for delirium based on the prediction model could improve postoperative care. The working model is provided online and is available for further verification among other populations.

Trial registration

KCT 0006363.

SUBMITTER: Lee DY

PROVIDER: S-EPMC10161528 | biostudies-literature | 2023 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Machine learning-based prediction model for postoperative delirium in non-cardiac surgery.

Lee Dong Yun DY Oh Ah Ran AR Park Jungchan J Lee Seung-Hwa SH Choi Byungjin B Yang Kwangmo K Kim Ha Yeon HY Park Rae Woong RW

BMC psychiatry 20230504 1

<h4>Background</h4>Postoperative delirium is a common complication that is distressing. This study aimed to demonstrate a prediction model for delirium.<h4>Methods</h4>Among 203,374undergoing non-cardiac surgery between January 2011 and June 2019 at Samsung Medical Center, 2,865 (1.4%) were diagnosed with postoperative delirium. After comparing performances of machine learning algorithms, we chose variables for a prediction model based on an extreme gradient boosting algorithm. Using the top fiv ...[more]

PMID: 37143035

Similar Datasets

Project description:BackgroundAccurate, pragmatic risk stratification for postoperative delirium (POD) is necessary to target preventative resources toward high-risk patients. Machine learning (ML) offers a novel approach to leveraging electronic health record (EHR) data for POD prediction. We sought to develop and internally validate a ML-derived POD risk prediction model using preoperative risk features, and to compare its performance to models developed with traditional logistic regression.MethodsThis was a retrospective analysis of preoperative EHR data from 24,885 adults undergoing a procedure requiring anesthesia care, recovering in the main post-anesthesia care unit, and staying in the hospital at least overnight between December 2016 and December 2019 at either of two hospitals in a tertiary care health system. One hundred fifteen preoperative risk features including demographics, comorbidities, nursing assessments, surgery type, and other preoperative EHR data were used to predict postoperative delirium (POD), defined as any instance of Nursing Delirium Screening Scale ≥2 or positive Confusion Assessment Method for the Intensive Care Unit within the first 7 postoperative days. Two ML models (Neural Network and XGBoost), two traditional logistic regression models ("clinician-guided" and "ML hybrid"), and a previously described delirium risk stratification tool (AWOL-S) were evaluated using the area under the receiver operating characteristic curve (AUC-ROC), sensitivity, specificity, positive likelihood ratio, and positive predictive value. Model calibration was assessed with a calibration curve. Patients with no POD assessments charted or at least 20% of input variables missing were excluded.ResultsPOD incidence was 5.3%. The AUC-ROC for Neural Net was 0.841 [95% CI 0. 816-0.863] and for XGBoost was 0.851 [95% CI 0.827-0.874], which was significantly better than the clinician-guided (AUC-ROC 0.763 [0.734-0.793], p < 0.001) and ML hybrid (AUC-ROC 0.824 [0.800-0.849], p < 0.001) regression models and AWOL-S (AUC-ROC 0.762 [95% CI 0.713-0.812], p < 0.001). Neural Net, XGBoost, and ML hybrid models demonstrated excellent calibration, while calibration of the clinician-guided and AWOL-S models was moderate; they tended to overestimate delirium risk in those already at highest risk.ConclusionUsing pragmatically collected EHR data, two ML models predicted POD in a broad perioperative population with high discrimination. Optimal application of the models would provide automated, real-time delirium risk stratification to improve perioperative management of surgical patients at risk for POD.

Project description:PurposeTo establish novel prediction models for predicting acute kidney injury (AKI) after cardiac surgery based on early postoperative biomarkers.Patients and methodsThis study enrolled patients who underwent cardiac surgery in a Chinese tertiary cardiac center and consisted of a discovery cohort (n = 452, from November 2018 to June 2019) and a validation cohort (n = 326, from December 2019 to May 2020). 43 biomarkers were screened using the least absolute shrinkage and selection operator and logistic regression to construct a nomogram model. Three tree-based machine learning models were also established: eXtreme Gradient Boosting (XGBoost), random forest (RF) and deep forest (DF). Model performance was accessed using area under the receiver operating characteristic curve (AUC). AKI was defined according to the Kidney Disease Improving Global Outcomes criteria.ResultsFive biomarkers were identified as independent predictors of AKI and were included in the nomogram: soluble ST2 (sST2), N terminal pro-brain natriuretic peptide (NT-proBNP), heart-type fatty acid binding protein (H-FABP), lactic dehydrogenase (LDH), and uric acid (UA). In the validation cohort, the nomogram achieved good discrimination, with AUC of 0.834. The machine learning models also exhibited adequate discrimination, with AUC of 0.856, 0.850, and 0.836 for DF, RF, and XGBoost, respectively. Both nomogram and machine learning models had well calibrated. The AUC of sST2, NT-proBNP, H-FABP, LDH, and UA to discriminate AKI were 0.670, 0.713, 0.725, 0.704, and 0.749, respectively. In addition, all of these biomarkers were significantly correlated with AKI after adjusting clinical confounders (odds ratio and 95% confidence interval of the third vs. the first tertile: sST2, 3.55 [2.34-5.49], NT-proBNP, 5.50 [3.54-8.71], H-FABP, 6.64 [4.11-11.06], LDH, 7.47 [4.54-12.64], and UA, 8.93 [5.46-15.06]).ConclusionOur study provides a series of novel predictive models and five biomarkers for enhancing the risk stratification of AKI after cardiac surgery.

Project description:BACKGROUND:Delirium is a temporary mental disorder that occasionally affects patients undergoing surgery, especially cardiac surgery. It is strongly associated with major adverse events, which in turn leads to increased cost and poor outcomes (eg, need for nursing home due to cognitive impairment, stroke, and death). The ability to foresee patients at risk of delirium will guide the timely initiation of multimodal preventive interventions, which will aid in reducing the burden and negative consequences associated with delirium. Several studies have focused on the prediction of delirium. However, the number of studies in cardiac surgical patients that have used machine learning methods is very limited. OBJECTIVE:This study aimed to explore the application of several machine learning predictive models that can pre-emptively predict delirium in patients undergoing cardiac surgery and compare their performance. METHODS:We investigated a number of machine learning methods to develop models that can predict delirium after cardiac surgery. A clinical dataset comprising over 5000 actual patients who underwent cardiac surgery in a single center was used to develop the models using logistic regression, artificial neural networks (ANN), support vector machines (SVM), Bayesian belief networks (BBN), naïve Bayesian, random forest, and decision trees. RESULTS:Only 507 out of 5584 patients (11.4%) developed delirium. We addressed the underlying class imbalance, using random undersampling, in the training dataset. The final prediction performance was validated on a separate test dataset. Owing to the target class imbalance, several measures were used to evaluate algorithm's performance for the delirium class on the test dataset. Out of the selected algorithms, the SVM algorithm had the best F1 score for positive cases, kappa, and positive predictive value (40.2%, 29.3%, and 29.7%, respectively) with a P=.01, .03, .02, respectively. The ANN had the best receiver-operator area-under the curve (78.2%; P=.03). The BBN had the best precision-recall area-under the curve for detecting positive cases (30.4%; P=.03). CONCLUSIONS:Although delirium is inherently complex, preventive measures to mitigate its negative effect can be applied proactively if patients at risk are prospectively identified. Our results highlight 2 important points: (1) addressing class imbalance on the training dataset will augment machine learning model's performance in identifying patients likely to develop postoperative delirium, and (2) as the prediction of postoperative delirium is difficult because it is multifactorial and has complex pathophysiology, applying machine learning methods (complex or simple) may improve the prediction by revealing hidden patterns, which will lead to cost reduction by prevention of complications and will optimize patients' outcomes.

Dataset Information

Machine learning-based prediction model for postoperative delirium in non-cardiac surgery.

Background

Methods

Results

Conclusion

Trial registration

Publications

Machine learning-based prediction model for postoperative delirium in non-cardiac surgery.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets