Development and Validation of a Multivariable Risk Prediction Model for COVID-19 Mortality in the Southern United States.
Ontology highlight
ABSTRACT: Objective
To evaluate clinical characteristics of patients admitted to the hospital with coronavirus disease 2019 (COVID-19) in Southern United States and development as well as validation of a mortality risk prediction model.Patients and methods
Southern Louisiana was an early hotspot during the pandemic, which provided a large collection of clinical data on inpatients with COVID-19. We designed a risk stratification model to assess the mortality risk for patients admitted to the hospital with COVID-19. Data from 1673 consecutive patients diagnosed with COVID-19 infection and hospitalized between March 1, 2020, and April 30, 2020, was used to create an 11-factor mortality risk model based on baseline comorbidity, organ injury, and laboratory results. The risk model was validated using a subsequent cohort of 2067 consecutive hospitalized patients admitted between June 1, 2020, and December 31, 2020.Results
The resultant model has an area under the curve of 0.783 (95% CI, 0.76 to 0.81), with an optimal sensitivity of 0.74 and specificity of 0.69 for predicting mortality. Validation of this model in a subsequent cohort of 2067 consecutively hospitalized patients yielded comparable prognostic performance.Conclusion
We have developed an easy-to-use, robust model for systematically evaluating patients presenting to acute care settings with COVID-19 infection.
SUBMITTER: Gupta A
PROVIDER: S-EPMC8445799 | biostudies-literature | 2021 Dec
REPOSITORIES: biostudies-literature
Publications
Development and Validation of a Multivariable Risk Prediction Model for COVID-19 Mortality in the Southern United States.
Gupta Aashish A Kachur Sergey M SM Tafur Jose D JD Patel Harsh K HK Timme Divina O DO Shariati Farnoosh F Rogers Kristen D KD Morin Daniel P DP Lavie Carl J CJ
Mayo Clinic proceedings 20210917 12
<h4>Objective</h4>To evaluate clinical characteristics of patients admitted to the hospital with coronavirus disease 2019 (COVID-19) in Southern United States and development as well as validation of a mortality risk prediction model.<h4>Patients and methods</h4>Southern Louisiana was an early hotspot during the pandemic, which provided a large collection of clinical data on inpatients with COVID-19. We designed a risk stratification model to assess the mortality risk for patients admitted to th ...[more]
Similar Datasets
Project description:Risk calculators can facilitate shared medical decision-making 1 . Demographics, comorbidities, medication use, geographic region, and other factors may increase the risk for COVID-19-related complications among patients with IBD 2,3 . Develop an individualized prognostic risk prediction tool for predicting the probability of adverse COVID-19 outcomes in patients with IBD. This study developed and validated prognostic penalized logistic regression models 4 using reports to Surveillance Epidemiology of Coronavirus Under Research Exclusion for Inflammatory Bowel Disease (SECURE-IBD) from March-October 2020. Model development was done using a training data set (85% of cases reported March 13 - September 15, 2020), and model validation was conducted using a test data set (the remaining 15% of cases plus all cases reported September 16-October 20, 2020). COVID-19 related:Hospitalization+: composite outcome of hospitalization, ICU admission, mechanical ventilation, or deathICU+: composite outcome of ICU admission, mechanical ventilation, or deathDeathWe assessed the resulting models' discrimination using the area under the curve (AUC) of the receiver-operator characteristic (ROC) curves and reported the corresponding 95% confidence intervals (CIs). We included 2709 cases from 59 countries (mean age 41.2 years [s.d. 18], 50.2% male). A total of 633 (24%) were hospitalized, 137 (5%) were admitted to the ICU or intubated, and 69 (3%) died. 2009 patients comprised the training set and 700 the test set.The models demonstrated excellent discrimination, with a test set AUC (95% CI) of 0.79 (0.75, 0.83) for Hospitalization+, 0.88 (0.82, 0.95) for ICU+, and 0.94 (0.89, 0.99) for Death. Age, comorbidities, corticosteroid use, and male gender were associated with higher risk of death, while use of biologic therapies was associated with a lower risk. Prognostic models can effectively predict who is at higher risk for COVID-19-related adverse outcomes in a population of IBD patients. A free online risk calculator ( https://covidibd.org/covid-19-risk-calculator/ ) is available for healthcare providers to facilitate discussion of risks due to COVID-19 with IBD patients. The tool numerically and visually summarizes the patient's probabilities of adverse outcomes and associated CIs. Helping physicians identify their highest-risk patients will be important in the coming months as cases rise in the US and worldwide. This tool can also serve as a model for risk stratification in other chronic diseases. Question: How well can a multivariable risk model predict the risk of hospitalization, intensive care unit (ICU) stay, or death due to COVID-19 in patients with inflammatory bowel disease (IBD)?Findings: Multivariable prediction models developed using data from an international voluntary registry of IBD patients and available for use online ( https://covidibd.org/ ) have very good discrimination for predicting hospitalization (Test set AUC 0.79) and excellent discrimination for ICU admission (Test set AUC 0.88) and death (Test set AUC 0.94). The models were developed with a training sample of 2009 cases and validated in an independent test sample of 700 cases comprised of a random sub-sample of cases and all cases entered in the registry during a one-month period after model development. Meaning: This risk prediction model may serve as an effective tool for healthcare providers to facilitate conversations about COVID-19-related risks with IBD patients.
| S-EPMC7836127 | biostudies-literature
Project description:ObjectivesDevelop an individualised prognostic risk prediction tool for predicting the probability of adverse COVID-19 outcomes in patients with inflammatory bowel disease (IBD).Design and settingThis study developed and validated prognostic penalised logistic regression models using reports to the international Surveillance Epidemiology of Coronavirus Under Research Exclusion for Inflammatory Bowel Disease voluntary registry from March to October 2020. Model development was done using a training data set (85% of cases reported 13 March-15 September 2020), and model validation was conducted using a test data set (the remaining 15% of cases plus all cases reported 16 September-20 October 2020).ParticipantsWe included 2709 cases from 59 countries (mean age 41.2 years (SD 18), 50.2% male). All submitted cases after removing duplicates were included.Primary and secondary outcome measuresCOVID-19 related: (1) Hospitalisation+: composite outcome of hospitalisation, ICU admission, mechanical ventilation or death; (2) Intensive Care Unit+ (ICU+): composite outcome of ICU admission, mechanical ventilation or death; (3) Death. We assessed the resulting models' discrimination using the area under the curve of the receiver operator characteristic curves and reported the corresponding 95% CIs.ResultsOf the submitted cases, a total of 633 (24%) were hospitalised, 137 (5%) were admitted to the ICU or intubated and 69 (3%) died. 2009 patients comprised the training set and 700 the test set. The models demonstrated excellent discrimination, with a test set area under the curve (95% CI) of 0.79 (0.75 to 0.83) for Hospitalisation+, 0.88 (0.82 to 0.95) for ICU+ and 0.94 (0.89 to 0.99) for Death. Age, comorbidities, corticosteroid use and male gender were associated with a higher risk of death, while the use of biological therapies was associated with a lower risk.ConclusionsPrognostic models can effectively predict who is at higher risk for COVID-19-related adverse outcomes in a population of patients with IBD. A free online risk calculator (https://covidibd.org/covid-19-risk-calculator/) is available for healthcare providers to facilitate discussion of risks due to COVID-19 with patients with IBD.
| S-EPMC8593277 | biostudies-literature
Project description:BackgroundIdentifying patients at risk for mortality from COVID-19 is crucial to triage, clinical decision-making, and the allocation of scarce hospital resources. The 4C Mortality Score effectively predicts COVID-19 mortality, but it has not been validated in a United States (U.S.) population. The purpose of this study is to determine whether the 4C Mortality Score accurately predicts COVID-19 mortality in an urban U.S. adult inpatient population.MethodsThis retrospective cohort study included adult patients admitted to a single-center, tertiary care hospital (Philadelphia, PA) with a positive SARS-CoV-2 PCR from 3/01/2020 to 6/06/2020. Variables were extracted through a combination of automated export and manual chart review. The outcome of interest was mortality during hospital admission or within 30 days of discharge.ResultsThis study included 426 patients; mean age was 64.4 years, 43.4% were female, and 54.5% self-identified as Black or African American. All-cause mortality was observed in 71 patients (16.7%). The area under the receiver operator characteristic curve of the 4C Mortality Score was 0.85 (95% confidence interval, 0.79-0.89).ConclusionsClinicians may use the 4C Mortality Score in an urban, majority Black, U.S. inpatient population. The derivation and validation cohorts were treated in the pre-vaccine era so the 4C Score may over-predict mortality in current patient populations. With stubbornly high inpatient mortality rates, however, the 4C Score remains one of the best tools available to date to inform thoughtful triage and treatment allocation.
| S-EPMC9054702 | biostudies-literature
Project description:Risk stratification of chronic obstructive pulmonary disease (COPD) patients is important to enable targeted management. Existing disease severity classification systems, such as GOLD staging, do not take co-morbidities into account despite their high prevalence in COPD patients. We sought to develop and validate a prognostic model to predict 10-year mortality in patients with diagnosed COPD. We constructed a longitudinal cohort of 37,485 COPD patients (149,196 person-years) from a UK-wide primary care database. The risk factors included in the model pertained to demographic and behavioural characteristics, co-morbidities, and COPD severity. The outcome of interest was all-cause mortality. We fitted an extended Cox-regression model to estimate hazard ratios (HR) with 95% confidence intervals (CI), used machine learning-based data modelling approaches including k-fold cross-validation to validate the prognostic model, and assessed model fitting and discrimination. The inter-quartile ranges of the three metrics on the validation set suggested good performance: 0.90-1.06 for model fit, 0.80-0.83 for Harrel's c-index, and 0.40-0.46 for Royston and Saurebrei's [Formula: see text] with a strong overlap of these metrics on the training dataset. According to the validated prognostic model, the two most important risk factors of mortality were heart failure (HR 1.92; 95% CI 1.87-1.96) and current smoking (HR 1.68; 95% CI 1.66-1.71). We have developed and validated a national, population-based prognostic model to predict 10-year mortality of patients diagnosed with COPD. This model could be used to detect high-risk patients and modify risk factors such as optimising heart failure management and offering effective smoking cessation interventions.
| S-EPMC9156666 | biostudies-literature
Project description:In Coronavirus disease 2019 (COVID-19), early identification of patients with a high risk of mortality can significantly improve triage, bed allocation, timely management, and possibly, outcome. The study objective is to develop and validate individualized mortality risk scores based on the anonymized clinical and laboratory data at admission and determine the probability of Deaths at 7 and 28 days. Data of 1393 admitted patients (Expired-8.54%) was collected from six Apollo Hospital centers (from April to July 2020) using a standardized template and electronic medical records. 63 Clinical and Laboratory parameters were studied based on the patient's initial clinical state at admission and laboratory parameters within the first 24 h. The Machine Learning (ML) modelling was performed using eXtreme Gradient Boosting (XGB) Algorithm. 'Time to event' using Cox Proportional Hazard Model was used and combined with XGB Algorithm. The prospective validation cohort was selected of 977 patients (Expired-8.3%) from six centers from July to October 2020. The Clinical API for the Algorithm is http://20.44.39.47/covid19v2/page1.php being used prospectively. Out of the 63 clinical and laboratory parameters, Age [adjusted hazard ratio (HR) 2.31; 95% CI 1.52-3.53], Male Gender (HR 1.72, 95% CI 1.06-2.85), Respiratory Distress (HR 1.79, 95% CI 1.32-2.53), Diabetes Mellitus (HR 1.21, 95% CI 0.83-1.77), Chronic Kidney Disease (HR 3.04, 95% CI 1.72-5.38), Coronary Artery Disease (HR 1.56, 95% CI - 0.91 to 2.69), respiratory rate > 24/min (HR 1.54, 95% CI 1.03-2.3), oxygen saturation below 90% (HR 2.84, 95% CI 1.87-4.3), Lymphocyte% in DLC (HR 1.99, 95% CI 1.23-2.32), INR (HR 1.71, 95% CI 1.31-2.13), LDH (HR 4.02, 95% CI 2.66-6.07) and Ferritin (HR 2.48, 95% CI 1.32-4.74) were found to be significant. The performance parameters of the current model is at AUC ROC Score of 0.8685 and Accuracy Score of 96.89. The validation cohort had the AUC of 0.782 and Accuracy of 0.93. The model for Mortality Risk Prediction provides insight into the COVID Clinical and Laboratory Parameters at admission. It is one of the early studies, reflecting on 'time to event' at the admission, accurately predicting patient outcomes.
| S-EPMC8211710 | biostudies-literature
Project description:BackgroundThe COVID-19 pandemic has affected millions of individuals and caused hundreds of thousands of deaths worldwide. Predicting mortality among patients with COVID-19 who present with a spectrum of complications is very difficult, hindering the prognostication and management of the disease. We aimed to develop an accurate prediction model of COVID-19 mortality using unbiased computational methods, and identify the clinical features most predictive of this outcome.MethodsIn this prediction model development and validation study, we applied machine learning techniques to clinical data from a large cohort of patients with COVID-19 treated at the Mount Sinai Health System in New York City, NY, USA, to predict mortality. We analysed patient-level data captured in the Mount Sinai Data Warehouse database for individuals with a confirmed diagnosis of COVID-19 who had a health system encounter between March 9 and April 6, 2020. For initial analyses, we used patient data from March 9 to April 5, and randomly assigned (80:20) the patients to the development dataset or test dataset 1 (retrospective). Patient data for those with encounters on April 6, 2020, were used in test dataset 2 (prospective). We designed prediction models based on clinical features and patient characteristics during health system encounters to predict mortality using the development dataset. We assessed the resultant models in terms of the area under the receiver operating characteristic curve (AUC) score in the test datasets.FindingsUsing the development dataset (n=3841) and a systematic machine learning framework, we developed a COVID-19 mortality prediction model that showed high accuracy (AUC=0·91) when applied to test datasets of retrospective (n=961) and prospective (n=249) patients. This model was based on three clinical features: patient's age, minimum oxygen saturation over the course of their medical encounter, and type of patient encounter (inpatient vs outpatient and telehealth visits).InterpretationAn accurate and parsimonious COVID-19 mortality prediction model based on three features might have utility in clinical settings to guide the management and prognostication of patients affected by this disease. External validation of this prediction model in other populations is needed.FundingNational Institutes of Health.
| S-EPMC7508513 | biostudies-literature
Project description:BackgroundBlack populations in the United States are being disproportionately affected by the COVID-19 pandemic, but the increased mortality burden after accounting for health and other demographic characteristics is not well understood. We examined characteristics of individuals who died from COVID-19 in Michigan by race stratified by their age, sex and comorbidity prevalence to illustrate and understand this disparity in mortality risk.MethodsWe evaluate COVID-19 mortality in Michigan by demographic and health characteristics, using individual-level linked death certificate and surveillance data collected by the Michigan Department of Health and Human Services from March 16 to October 26, 2020. We identified differences in demographics and comorbidity prevalence across race among individuals who died from COVID-19 and calculated mortality rates by age, sex, race, and number of comorbidities.FindingsAmong the 6,065 COVID-19 related deaths in Michigan, Black individuals are experiencing 3·6 times the mortality rate of White individuals (p<0.001), with a mortality rate for Black individuals under 65 years without comorbidities that is 12·6 times that of their White counterparts (p<0.001). After accounting for age, race, sex, and number of comorbidities, we find that Black individuals in all strata are at higher risk of COVID-19 mortality than their White counterparts.InterpretationOur findings demonstrate that Black populations are disproportionately burdened by COVID-19 mortality, even after accounting for demographic and underlying health characteristics. We highlight how disparities across race, which result from systemic racism, are compounded in crises.FundingASP, AP and APG were funded by NSF Expeditions grant 1918784, NIH grant 1R01AI151176-01, NSF Rapid Response Research for COVID-19 grant RAPID-2027755, and the Notsew Orm Sands Foundation. MCF was supported by NIH grant K01AI141576.
| S-EPMC7933264 | biostudies-literature
Project description:AimsPrevious studies suggest relatively increased cardiovascular risk after COVID-19 infection. This study assessed incidence and explored individual risk and timing of cardiovascular disease occurring post-COVID-19 in a large primary care database.Methods and resultsData were extracted from the UK's Clinical Practice Research Datalink. Incidence rates within 180 days post-infection were estimated for arterial or venous events, inflammatory heart disease, and new-onset atrial fibrillation or heart failure. Next, multivariable logistic regression models were developed on 220 751 adults with COVID-19 infection before 1 December 2020 using age, sex and traditional cardiovascular risk factors. All models were externally validated in (i) 138 034 vaccinated and (ii) 503 404 unvaccinated adults with a first COVID-19 infection after 1 December 2020. Discriminative performance and calibration were evaluated with internal and external validation. Increased incidence rates were observed up to 60 days after COVID-19 infection for venous and arterial cardiovascular events and new-onset atrial fibrillation, but not for inflammatory heart disease or heart failure, with the highest rate for venous events (13 per 1000 person-years). The best prediction models had c-statistics of 0.90 or higher. However, <5% of adults had a predicted 180-day outcome-specific risk larger than 1%. These rare outcomes complicated calibration.ConclusionRisks of arterial and venous cardiovascular events and new-onset atrial fibrillation are increased within the first 60 days after COVID-19 infection in the general population. Models' c-statistics suggest high discrimination, but because of the very low absolute risks, they are insufficient to inform individual risk management.
| S-EPMC10690016 | biostudies-literature
Project description:Most of the existing prediction models for COVID-19 lack validation, are inadequately reported or are at high risk of bias, a reason which has led to discourage their use. Few existing models have the potential to be extensively used by healthcare providers in low-resource settings since many require laboratory and imaging predictors. Therefore, we sought to develop and validate a multivariable prediction model of death in Mexican patients with COVID-19, by using demographic and patient history predictors. We conducted a national retrospective cohort study in two different sets of patients from the Mexican COVID-19 Epidemiologic Surveillance Study. Patients with a positive reverse transcription-polymerase chain reaction for SARS-CoV-2 and complete unduplicated data were eligible. In total, 83 779 patients were included to develop the scoring system through a multivariable Cox regression model; 100 000, to validate the model. Eight predictors (age, sex, diabetes, chronic obstructive pulmonary disease, immunosuppression, hypertension, obesity and chronic kidney disease) were included in the scoring system called PH-Covid19 (range of values: -2 to 25 points). The predictive model has a discrimination of death of 0.8 (95% confidence interval (CI) 0.796-0.804). The PH-Covid19 scoring system was developed and validated in Mexican patients to aid clinicians to stratify patients with COVID-19 at risk of fatal outcomes, allowing for better and efficient use of resources.
| S-EPMC7729170 | biostudies-literature
Project description:BackgroundEarly prediction of prognosis may help early treatment measures to reduce mortality in critically ill coronavirus disease (COVID-19) patients. The study aimed to develop a mortality prediction model for critically ill COVID-19 patients.MethodsThis retrospective study analyzed the clinical data of critically ill COVID-19 patients in an intensive care unit between April and June 2022. Propensity matching scores were used to reduce the effect of confounding factors. A predictive model was built using logistic regression analysis and visualized using a nomogram. Calibration and receiver operating characteristic (ROC) curves were used to estimate the accuracy and predictive value of the model. Decision curve analysis (DCA) was used to examine the value of the model for clinical interventions.ResultsIn total, 137 critically ill COVID-19 patients were enrolled; 84 survived, and 53 died. Univariate and multivariate logistic regression analyses revealed that aspartate aminotransferase (AST), creatinine, and myoglobin levels were independent prognostic factors. We constructed logistic regression prediction models using the seven least absolute shrinkage and selection operator regression-selected variables (hematocrit, red blood cell distribution width-standard deviation, procalcitonin, AST, creatinine, potassium, and myoglobin; Model 1) and three independent factor variables (Model 2). The calibration curves suggested that the actual predictions of the two models were similar to the ideal predictions. The ROC curve indicated that both models had good predictive power, and Model 1 had better predictive power than Model 2. The DCA results suggested that the model intervention was beneficial to patients and patients benefited more from Model 1 than from Model 2.ConclusionThe predictive model constructed using characteristic variables screened using LASSO regression can accurately predict the prognosis of critically ill COVID-19 patients. This model can assist clinicians in implementing early interventions. External validation by prospective large-sample studies is required.
| S-EPMC11228157 | biostudies-literature