Dataset Information

Development and External Validation of a Machine Learning Model for Progression of CKD.

ABSTRACT:

Introduction

Prediction of disease progression at all stages of chronic kidney disease (CKD) may help improve patient outcomes. As such, we aimed to develop and externally validate a random forest model to predict progression of CKD using demographics and laboratory data.

Methods

The model was developed in a population-based cohort from Manitoba, Canada, between April 1, 2006, and December 31, 2016, with external validation in Alberta, Canada. A total of 77,196 individuals with an estimated glomerular filtration rate (eGFR) > 10 ml/min per 1.73 m² and a urine albumin-to-creatinine ratio (ACR) available were included from Manitoba and 107,097 from Alberta. We considered >80 laboratory features, including analytes from complete blood cell counts, chemistry panels, liver enzymes, urine analysis, and quantification of urine albumin and protein. The primary outcome in our study was a 40% decline in eGFR or kidney failure. We assessed model discrimination using the area under the receiver operating characteristic curve (AUC) and calibration using plots of observed and predicted risks.

Results

The final model achieved an AUC of 0.88 (95% CI 0.87-0.89) at 2 years and 0.84 (0.83-0.85) at 5 years in internal testing. Discrimination and calibration were preserved in the external validation data set with AUC scores of 0.87 (0.86-0.88) at 2 years and 0.84 (0.84-0.86) at 5 years. The top 30% of individuals predicted as high risk and intermediate risk represent 87% of CKD progression events in 2 years and 77% of progression events in 5 years.

Conclusion

A machine learning model that leverages routinely collected laboratory data can predict eGFR decline or kidney failure with accuracy.

SUBMITTER: Ferguson T

PROVIDER: S-EPMC9366291 | biostudies-literature | 2022 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and External Validation of a Machine Learning Model for Progression of CKD.

Ferguson Thomas T Ravani Pietro P Sood Manish M MM Clarke Alix A Komenda Paul P Rigatto Claudio C Tangri Navdeep N

Kidney international reports 20220513 8

<h4>Introduction</h4>Prediction of disease progression at all stages of chronic kidney disease (CKD) may help improve patient outcomes. As such, we aimed to develop and externally validate a random forest model to predict progression of CKD using demographics and laboratory data.<h4>Methods</h4>The model was developed in a population-based cohort from Manitoba, Canada, between April 1, 2006, and December 31, 2016, with external validation in Alberta, Canada. A total of 77,196 individuals with an ...[more]

PMID: 35967110

Similar Datasets

Project description:BackgroundThough European Respiratory Society and American Thoracic Society (ERS/ATS) guidelines for pulmonary function test (PFT) interpretation recommend the use of the forced vital capacity (FVC) lower limit of normal (LLN) to exclude restriction, recent data suggest that the negative predictive value (NPV) of the FVC LLN is lower than has been accepted, particularly among non-Hispanic Black patients. We sought to develop and externally validate a machine learning (ML) model to predict restriction from spirometry and determine whether its use may improve the accuracy and equity of PFT interpretation.MethodsWe included PFTs with both static and dynamic lung volume measurements for patients between 18 and 80 years of age who were tested at pulmonary diagnostic labs within two health systems. We used PFTs from one health system to train logistic regression, random forest, and boosted tree models to predict restriction using demographic, anthropometric, and spirometric data. We used PFTs from the second health system to externally validate these models. The primary measure of model performance was the NPV. Racial equity was assessed by comparing the NPV among non-Hispanic Black and non-Hispanic White patients.FindingsA total of 42 462 PFTs were used for model development and 24 524 for external validation. The prevalence of restriction was 29.8% in the development dataset and 39.6% in the validation dataset. All three ML models outperformed the FVC LLN by a wide margin, both overall and among all demographic subgroups. The overall NPV of the random forest model (88.3%, 95% confidence interval [CI] 87.8% to 88.9%) was significantly greater than that of the FVC LLN (72.7%, 95% CI 72.1% to 73.3%). The NPV of the random forest model was greater than that of the FVC LLN among both non-Hispanic Black (74.6% [95% CI 72.5% to 76.6%] versus 49.5% [95% CI 47.8% to 51.2%]) and non-Hispanic White (90.9% [95% CI 90.3% to 91.5%] versus 79.6% [95% CI 78.9% to 80.3%]) patients.InterpretationML models to exclude restriction from spirometry improve the accuracy and equity of PFT interpretation but do not fully eliminate racial differences.

Project description:Rationale & Objective Chronic kidney disease (CKD) is a major cause of morbidity and mortality. To date, there are no widely used machine-learning models that can predict progressive CKD across the entire disease spectrum, including the earliest stages. The objective of this study was to use readily available demographic and laboratory data from Sonic Healthcare USA laboratories to train and test the performance of machine learning-based predictive risk models for CKD progression. Study Design Retrospective observational study Setting & Participants The study population was composed of deidentified laboratory information services data procured from a large US outpatient laboratory network. The retrospective data set included 110,264 adult patients over a 5-year period with initial estimated glomerular filtration rate (eGFR) values between 15-89 mL/min/1.73 m2. Predictors Patient demographic and laboratory characteristics. Outcomes Accelerated (ie, >30%) eGFR decline associated with CKD progression within 5 years. Analytical Approach Machine-learning models were developed using random forest survival methods, with laboratory-based risk factors analyzed as potential predictors of significant eGFR decline. Results The 7-variable risk classifier model accurately predicted an eGFR decline of >30% within 5 years and achieved an area under the curve receiver-operator characteristic of 0.85. The most important predictor of progressive decline in kidney function was the eGFR slope. Other key contributors to the model included initial eGFR, urine albumin-creatinine ratio, serum albumin (initial and slope), age, and sex. Limitations The cohort study did not evaluate the role of clinical variables (eg, blood pressure) on the performance of the model. Conclusions Our progressive CKD classifier accurately predicts significant eGFR decline in patients with early, mid, and advanced disease using readily obtainable laboratory data. Although prospective studies are warranted, our results support the clinical utility of the model to improve timely recognition and optimal management for patients at risk for CKD progression. Plain-Language Summary Defined by a significant decrease in estimated glomerular filtration rate (eGFR), chronic kidney disease (CKD) progression is strongly associated with kidney failure. However, to date, there are no broadly used resources that can predict this clinically significant event. Using machine-learning techniques on a diverse US population, this cohort study aimed to address this deficiency and found that a 5-year risk prediction model for CKD progression was accurate. The most important predictor of progressive decline in kidney function was the eGFR slope, followed by the urine albumin-creatinine ratio and serum albumin slope. Although further study is warranted, the results showed that a machine-learning model using readily obtainable laboratory information accurately predicts CKD progression, which may inform clinical diagnosis and management for this at-risk population. Graphical abstract

Project description:BackgroundMost patients diagnosed with breast cancer present with a node-negative disease. Sentinel lymph node biopsy (SLNB) is routinely used for axillary staging, leaving patients with healthy axillary lymph nodes without therapeutic effects but at risk of morbidities from the intervention. Numerous studies have developed nodal status prediction models for noninvasive axillary staging using postoperative data or imaging features that are not part of the diagnostic workup. Lymphovascular invasion (LVI) is a top-ranked predictor of nodal metastasis; however, its preoperative assessment is challenging.ObjectiveThis paper aimed to externally validate a multilayer perceptron (MLP) model for noninvasive lymph node staging (NILS) in a large population-based cohort (n=18,633) and develop a new MLP in the same cohort. Data were extracted from the Swedish National Quality Register for Breast Cancer (NKBC, 2014-2017), comprising only routinely and preoperatively available documented clinicopathological variables. A secondary aim was to develop and validate an LVI MLP for imputation of missing LVI status to increase the preoperative feasibility of the original NILS model.MethodsThree nonoverlapping cohorts were used for model development and validation. A total of 4 MLPs for nodal status and 1 LVI MLP were developed using 11 to 12 routinely available predictors. Three nodal status models were used to account for the different availabilities of LVI status in the cohorts and external validation in NKBC. The fourth nodal status model was developed for 80% (14,906/18,663) of NKBC cases and validated in the remaining 20% (3727/18,663). Three alternatives for imputation of LVI status were compared. The discriminatory capacity was evaluated using the validation area under the receiver operating characteristics curve (AUC) in 3 of the nodal status models. The clinical feasibility of the models was evaluated using calibration and decision curve analyses.ResultsExternal validation of the original NILS model was performed in NKBC (AUC 0.699, 95% CI 0.690-0.708) with good calibration and the potential of sparing 16% of patients with node-negative disease from SLNB. The LVI model was externally validated (AUC 0.747, 95% CI 0.694-0.799) with good calibration but did not improve the discriminatory performance of the nodal status models. A new nodal status model was developed in NKBC without information on LVI (AUC 0.709, 95% CI: 0.688-0.729), with excellent calibration in the holdout internal validation cohort, resulting in the potential omission of 24% of patients from unnecessary SLNBs.ConclusionsThe NILS model was externally validated in NKBC, where the imputation of LVI status did not improve the model's discriminatory performance. A new nodal status model demonstrated the feasibility of using register data comprising only the variables available in the preoperative setting for NILS using machine learning. Future steps include ongoing preoperative validation of the NILS model and extending the model with, for example, mammography images.

Project description:ObjectivesTo develop and externally validate machine learning models using structured and unstructured electronic health record data to predict postoperative acute kidney injury (AKI) across inpatient settings.Materials and methodsData for adult postoperative admissions to the Loyola University Medical Center (2009-2017) were used for model development and admissions to the University of Wisconsin-Madison (2009-2020) were used for validation. Structured features included demographics, vital signs, laboratory results, and nurse-documented scores. Unstructured text from clinical notes were converted into concept unique identifiers (CUIs) using the clinical Text Analysis and Knowledge Extraction System. The primary outcome was the development of Kidney Disease Improvement Global Outcomes stage 2 AKI within 7 days after leaving the operating room. We derived unimodal extreme gradient boosting machines (XGBoost) and elastic net logistic regression (GLMNET) models using structured-only data and multimodal models combining structured data with CUI features. Model comparison was performed using the receiver operating characteristic curve (AUROC), with Delong's test for statistical differences.ResultsThe study cohort included 138 389 adult patient admissions (mean [SD] age 58 [16] years; 11 506 [8%] African-American; and 70 826 [51%] female) across the 2 sites. Of those, 2959 (2.1%) developed stage 2 AKI or higher. Across all data types, XGBoost outperformed GLMNET (mean AUROC 0.81 [95% confidence interval (CI), 0.80-0.82] vs 0.78 [95% CI, 0.77-0.79]). The multimodal XGBoost model incorporating CUIs parameterized as term frequency-inverse document frequency (TF-IDF) showed the highest discrimination performance (AUROC 0.82 [95% CI, 0.81-0.83]) over unimodal models (AUROC 0.79 [95% CI, 0.78-0.80]).DiscussionA multimodality approach with structured data and TF-IDF weighting of CUIs increased model performance over structured data-only models.ConclusionThese findings highlight the predictive power of CUIs when merged with structured data for clinical prediction models, which may improve the detection of postoperative AKI.

Dataset Information

Development and External Validation of a Machine Learning Model for Progression of CKD.

Introduction

Methods

Results

Conclusion

Publications

Development and External Validation of a Machine Learning Model for Progression of CKD.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets