Dataset Information

Development and validation of machine learning-based clinical decision support tool for identifying malnutrition in NICU patients.

ABSTRACT: Hospitalized newborns have an increased risk of malnutrition and, especially preterm infants, often experience malnutrition-related extrauterine growth restriction (EUGR). The aim of this study was to predict the discharge weight and the presence of weight gain at discharge with machine learning (ML) algorithms. The demographic and clinical parameters were used to develop the models using fivefold cross-validation in the software-R with a neonatal nutritional screening tool (NNST). A total of 512 NICU patients were prospectively included in the study. Length of hospital stay (LOS), parenteral nutrition treatment (PN), postnatal age (PNA), surgery, and sodium were the most important variables in predicting the presence of weight gain at discharge with a random forest classification (AUROC:0.847). The AUROC of NNST-Plus, which was improved by adding LOS, PN, PNA, surgery, and sodium to NNST, increased by 16.5%. In addition, weight at admission, LOS, gestation-adjusted age at admission (> 40 weeks), sex, gestational age, birth weight, PNA, SGA, complications of labor and delivery, multiple birth, serum creatinine, and PN treatment were the most important variables in predicting discharge weight with an elastic net regression (R² = 0.748). This is the first study on the early prediction of EUGR with promising clinical performance based on ML algorithms. It is estimated that the incidence of EUGR can be improved with the implementation of this ML-based web tool ( http://www.softmed.hacettepe.edu.tr/NEO-DEER/ ) in clinical practice.

SUBMITTER: Yalcın N

PROVIDER: S-EPMC10063679 | biostudies-literature | 2023 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and validation of machine learning-based clinical decision support tool for identifying malnutrition in NICU patients.

Yalçın Nadir N Kaşıkcı Merve M Çelik Hasan Tolga HT Demirkan Kutay K Yiğit Şule Ş Yurdakök Murat M

Scientific reports 20230330 1

Hospitalized newborns have an increased risk of malnutrition and, especially preterm infants, often experience malnutrition-related extrauterine growth restriction (EUGR). The aim of this study was to predict the discharge weight and the presence of weight gain at discharge with machine learning (ML) algorithms. The demographic and clinical parameters were used to develop the models using fivefold cross-validation in the software-R with a neonatal nutritional screening tool (NNST). A total of 51 ...[more]

PMID: 36997630

Similar Datasets

Project description:BackgroundMachine learning (ML)-based clinical decision support systems (CDSS) are popular in clinical practice settings but are often criticized for being limited in usability, interpretability, and effectiveness. Evaluating the implementation of ML-based CDSS is critical to ensure CDSS is acceptable and useful to clinicians and helps them deliver high-quality health care. Malnutrition is a common and underdiagnosed condition among hospital patients, which can have serious adverse impacts. Early identification and treatment of malnutrition are important.ObjectiveThis study aims to evaluate the implementation of an ML tool, Malnutrition Universal Screening Tool (MUST)-Plus, that predicts hospital patients at high risk for malnutrition and identify best implementation practices applicable to this and other ML-based CDSS.MethodsWe conducted a qualitative postimplementation evaluation using in-depth interviews with registered dietitians (RDs) who use MUST-Plus output in their everyday work. After coding the data, we mapped emergent themes onto select domains of the nonadoption, abandonment, scale-up, spread, and sustainability (NASSS) framework.ResultsWe interviewed 17 of the 24 RDs approached (71%), representing 37% of those who use MUST-Plus output. Several themes emerged: (1) enhancements to the tool were made to improve accuracy and usability; (2) MUST-Plus helped identify patients that would not otherwise be seen; perceived usefulness was highest in the original site; (3) perceived accuracy varied by respondent and site; (4) RDs valued autonomy in prioritizing patients; (5) depth of tool understanding varied by hospital and level; (6) MUST-Plus was integrated into workflows and electronic health records; and (7) RDs expressed a desire to eventually have 1 automated screener.ConclusionsOur findings suggest that continuous involvement of stakeholders at new sites given staff turnover is vital to ensure buy-in. Qualitative research can help identify the potential bias of ML tools and should be widely used to ensure health equity. Ongoing collaboration among CDSS developers, data scientists, and clinical providers may help refine CDSS for optimal use and improve the acceptability of CDSS in the clinical context.

Project description:BackgroundComputerized physician order entry (CPOE) systems are incorporated into clinical decision support systems (CDSSs) to reduce medication errors and improve patient safety. Automatic alerts generated from CDSSs can directly assist physicians in making useful clinical decisions and can help shape prescribing behavior. Multiple studies reported that approximately 90%-96% of alerts are overridden by physicians, which raises questions about the effectiveness of CDSSs. There is intense interest in developing sophisticated methods to combat alert fatigue, but there is no consensus on the optimal approaches so far.ObjectiveOur objective was to develop machine learning prediction models to predict physicians' responses in order to reduce alert fatigue from disease medication-related CDSSs.MethodsWe collected data from a disease medication-related CDSS from a university teaching hospital in Taiwan. We considered prescriptions that triggered alerts in the CDSS between August 2018 and May 2019. Machine learning models, such as artificial neural network (ANN), random forest (RF), naïve Bayes (NB), gradient boosting (GB), and support vector machine (SVM), were used to develop prediction models. The data were randomly split into training (80%) and testing (20%) datasets.ResultsA total of 6453 prescriptions were used in our model. The ANN machine learning prediction model demonstrated excellent discrimination (area under the receiver operating characteristic curve [AUROC] 0.94; accuracy 0.85), whereas the RF, NB, GB, and SVM models had AUROCs of 0.93, 0.91, 0.91, and 0.80, respectively. The sensitivity and specificity of the ANN model were 0.87 and 0.83, respectively.ConclusionsIn this study, ANN showed substantially better performance in predicting individual physician responses to an alert from a disease medication-related CDSS, as compared to the other models. To our knowledge, this is the first study to use machine learning models to predict physician responses to alerts; furthermore, it can help to develop sophisticated CDSSs in real-world clinical settings.

Project description:BackgroundBreast cancer is a leading global health concern, necessitating advancements in recurrence prediction and management. The development of an artificial intelligence (AI)-based clinical decision support system (AI-CDSS) using ChatGPT addresses this need with the aim of enhancing both prediction accuracy and user accessibility.ObjectiveThis study aims to develop and validate an advanced machine learning model for a web-based AI-CDSS application, leveraging the question-and-answer guidance capabilities of ChatGPT to enhance data preprocessing and model development, thereby improving the prediction of breast cancer recurrence.MethodsThis study focused on developing an advanced machine learning model by leveraging data from the Tri-Service General Hospital breast cancer registry of 3577 patients (2004-2016). As a tertiary medical center, it accepts referrals from four branches-3 branches in the northern region and 1 branch on an offshore island in our country-that manage chronic diseases but refer complex surgical cases, including breast cancer, to the main center, enriching our study population's diversity. Model training used patient data from 2004 to 2012, with subsequent validation using data from 2013 to 2016, ensuring comprehensive assessment and robustness of our predictive models. ChatGPT is integral to preprocessing and model development, aiding in hormone receptor categorization, age binning, and one-hot encoding. Techniques such as the synthetic minority oversampling technique address the imbalance of data sets. Various algorithms, including light gradient-boosting machine, gradient boosting, and extreme gradient boosting, were used, and their performance was evaluated using metrics such as the area under the curve, accuracy, sensitivity, and F1-score.ResultsThe light gradient-boosting machine model demonstrated superior performance, with an area under the curve of 0.80, followed closely by the gradient boosting and extreme gradient boosting models. The web interface of the AI-CDSS tool was effectively tested in clinical decision-making scenarios, proving its use in personalized treatment planning and patient involvement.ConclusionsThe AI-CDSS tool, enhanced by ChatGPT, marks a significant advancement in breast cancer recurrence prediction, offering a more individualized and accessible approach for clinicians and patients. Although promising, further validation in diverse clinical settings is recommended to confirm its efficacy and expand its use.

Project description:BackgroundPrediabetes and diabetes are both abnormal states of glucose metabolism (AGM) that can lead to severe complications. Early detection of AGM is crucial for timely intervention and treatment. However, fasting blood glucose (FBG) as a mass population screening method may fail to identify some individuals who are actually AGM but with normoglycemia. This study aimed to develop and validate machine learning (ML) models to identify AGM among individuals with normoglycemia using routine health check-up indicators.MethodsAccording to the American Diabetes Association (ADA) criteria, participants with normoglycemia (FBG ≤ 5.6 mmol/L) were collected from 2019 to 2023, and then divided into AGM and Normal groups using glycosylated haemoglobin (HbA1c) 5.7% as the threshold. Data from 2019 to 2022 were divided into training and internal validation sets at a 7:3 ratio, while data from 2023 were used as the external validation set. Seven ML algorithms-including logistic regression (LR), random forest (RF), support vector machine (SVM), extreme gradient boosting machine, multilayer perceptron (MLP), light gradient boosting machine (LightGBM), and categorical boosting (CatBoost)-were used to build models for identifying AGM in normoglycemia population. Model performance was evaluated using the area under the receiver operating characteristic curve (auROC) and the precision-recall curve (auPR). The feature contributions to the optimal model was visualised using the SHapley Additive exPlanations (SHAP). Finally, an intuitive and user-friendly interactive interface was developed.ResultsA total of 59,259 participants were finally enroled in this study, and then divided into the training set of 32,810, the internal validation set of 14,060, and the external validation set of 12,389. The Catboost model outperformed the others with auROC of 0.806 and 0.794 for the internal and external validation set, respectively. Age was the most important feature influencing the performance of the CatBoost model, followed by fasting blood glucose, red blood cells, haemoglobin, body mass index, and triglyceride-glucose.ConclusionA well-performed ML model to identify AGM in the normoglycemia population was built, offering significant potential for early intervention and treatment of AGM that would otherwise have been missed.

Dataset Information

Development and validation of machine learning-based clinical decision support tool for identifying malnutrition in NICU patients.

Publications

Development and validation of machine learning-based clinical decision support tool for identifying malnutrition in NICU patients.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets