Dataset Information

Medicare Claim-Based National Institutes of Health Stroke Scale to Predict 30-Day Mortality and Hospital Readmission.

ABSTRACT:

Background

The Centers for Medicare and Medicaid Services (CMS) penalizes hospitals for higher than expected 30-day mortality rates using methods without accounting for condition severity risk adjustment. For patients with stroke, CMS claims did not quantify stroke severity until recently, when the National Institutes of Health Stroke Scale (NIHSS) reporting began.

Objective

Examine the predictive ability of claim-based NIHSS to predict 30-day mortality and 30-day hospital readmission in patients with ischemic stroke.

Design

Retrospective cohort study of Medicare claims data.

Patients

Medicare beneficiaries with ischemic stroke (N=43,241) acute hospitalization between October 2016 and November 2017.

Measurements

All-cause 30-day mortality and 30-day hospital readmission. NIHSS score was derived from ICD-10 codes and stratified into the following: minor to moderate, moderate, moderate to severe, and severe categories.

Results

Among 43,241 patients with ischemic stroke with NIHSS from 2,659 US hospitals, 64.6% had minor to moderate stroke, 14.3% had moderate, 12.7% had moderate to severe, and 8.5% had a severe stroke,10.1% died within 30 days, 12.1% were readmitted within 30 days. The NIHSS exhibited stronger discriminant property (C-statistic 0.83, 95% CI: 0.82-0.84) for 30-day mortality compared to Elixhauser (0.74, 95% CI: 0.73-0.75). A monotonic increase in the adjusted 30-day mortality risk occurred relative to minor to moderate stroke category: hazard ratio [HR]=2.92 (95% CI=2.59-3.29) for moderate stroke, HR=5.49 (95% CI=4.90-6.15) for moderate to severe stroke, and HR=7.82 (95% CI=6.95-8.80) for severe stroke. After accounting for competing risk of mortality, there was a significantly higher readmission risk in the moderate stroke (HR=1.11, 95% CI=1.03-1.20), but significantly lower readmission risk in the severe stroke (HR=0.84, 95% CI=0.74-0.95) categories.

Limitation

Timing of NIHSS reporting during hospitalization is unknown.

Conclusions

Medicare claim-based NIHSS is significantly associated with 30-day mortality in Medicare patients with ischemic stroke and significantly improves discriminant property relative to the Elixhauser comorbidity index.

SUBMITTER: Kumar A

PROVIDER: S-EPMC9411458 | biostudies-literature | 2022 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Medicare Claim-Based National Institutes of Health Stroke Scale to Predict 30-Day Mortality and Hospital Readmission.

Kumar Amit A Roy Indrakshi I Bosch Pamela R PR Fehnel Corey R CR Garnica Nicholas N Cook Jon J Warren Meghan M Karmarkar Amol M AM

Journal of general internal medicine 20211026 11

<h4>Background</h4>The Centers for Medicare and Medicaid Services (CMS) penalizes hospitals for higher than expected 30-day mortality rates using methods without accounting for condition severity risk adjustment. For patients with stroke, CMS claims did not quantify stroke severity until recently, when the National Institutes of Health Stroke Scale (NIHSS) reporting began.<h4>Objective</h4>Examine the predictive ability of claim-based NIHSS to predict 30-day mortality and 30-day hospital readmis ...[more]

PMID: 34704206

Similar Datasets

Project description:BackgroundHospital readmissions for pneumonia are a growing concern in the US, with significant consequences for costs and quality of care. This study developed the rule-based model and other machine learning (ML) models to predict 30-day readmission risk in patients with pneumonia and compared model performance.MethodsThis population-based study involved patients aged ≥ 18 years hospitalized with pneumonia from January 1, 2016, through November 30, 2016, using the Healthcare Cost and Utilization Project-National Readmission Database (HCUP-NRD). Rule-based algorithms and other ML algorithms, specifically decision trees, random forest, extreme gradient descent boosting (XGBoost), and Least Absolute Shrinkage and Selection Operator (LASSO), were used to model all-cause readmissions 30 days post-discharge from index pneumonia hospitalization. A total of 61 clinically relevant variables were included for ML model development. Models were trained on randomly partitioned 50% of the data and evaluated using the remaining dataset. Model hyperparameters were tuned using the ten-fold cross-validation on the resampled training dataset. The area under the receiver operating curves (AUROC) and area under precision-recall curves (AUPRC) were calculated for the testing set to evaluate the model performance.ResultsOf the 372,293 patients with an index hospital hospitalization for pneumonia, 48,280 (12.97%) were readmitted within 30 days. Judged by AUROC in the testing data, rule-based model (0.6591) significantly outperformed decision tree (0.5783, p value < 0.001), random forest (0.6509, p value < 0.01) and LASSO (0.6087, p value < 0.001), but was less superior than XGBoost (0.6606, p value = 0.015). The AUPRC of the rule-based model in the testing data (0.2146) was higher than the decision tree (0.1560), random forest (0.2052), and LASSO (0.2042), but was similar to XGBoost (0.2147). The top risk-predictive rules captured by the rule-based algorithm were comorbidities, illness severity, disposition locations, payer type, age, and length of stay. These predictive risk factors were also identified by other ML models with high variable importance.ConclusionThe performance of machine learning models for predicting readmission in pneumonia patients varied. The XGboost was better than the rule-based model based on the AUROC. However, important risk factors for predicting readmission remained consistent across ML models.

Project description:BackgroundLowering hospital readmission rates has become a primary target for the Centers for Medicare & Medicaid Services, but studies of the relationship between adherence to the recommended hospital care processes and readmission rates have provided inconsistent and inconclusive results.ObjectiveTo examine the association between hospital performance on Medicare's Hospital Compare process quality measures and 30-day readmission rates for patients with acute myocardial infarction (AMI), heart failure and pneumonia, and for those undergoing major surgery.Design, setting and participantsWe assessed hospital performance on process measures using the 2007 Hospital Inpatient Quality Reporting Program. The process measures for each condition were aggregated in two separate measures: Overall Measure (OM) and Appropriate Care Measure (ACM) scores. Readmission rates were calculated using Medicare claims.Main outcome measureRisk-standardized 30-day all-cause readmission rate was calculated as the ratio of predicted to expected rate standardized by the overall mean readmission rate. We calculated predicted readmission rate using hierarchical generalized linear models and adjusting for patient-level factors.ResultsAmong patients aged ≥ 66 years, the median OM score ranged from 79.4 % for abdominal surgery to 95.7 % for AMI, and the median ACM scores ranged from 45.8 % for abdominal surgery to 87.9 % for AMI. We observed a statistically significant, but weak, correlation between performance scores and readmission rates for pneumonia (correlation coefficient R = 0.07), AMI (R = 0.10), and orthopedic surgery (R = 0.06). The difference in the mean readmission rate between hospitals in the 1st and 4th quartiles of process measure performance was statistically significant only for AMI (0.25 percentage points) and pneumonia (0.31 percentage points). Performance on process measures explained less than 1 % of hospital-level variation in readmission rates.ConclusionsHospitals with greater adherence to recommended care processes did not achieve meaningfully better 30-day hospital readmission rates compared to those with lower levels of performance.

Project description:Background and Purpose: Hospital readmissions impose a substantial burden on the healthcare system. Reducing readmissions after stroke could lead to improved quality of care especially since stroke is associated with a high rate of readmission. The goal of this study is to enhance our understanding of the predictors of 30-day readmission after ischemic stroke and develop models to identify high-risk individuals for targeted interventions. Methods: We used patient-level data from electronic health records (EHR), five machine learning algorithms (random forest, gradient boosting machine, extreme gradient boosting-XGBoost, support vector machine, and logistic regression-LR), data-driven feature selection strategy, and adaptive sampling to develop 15 models of 30-day readmission after ischemic stroke. We further identified important clinical variables. Results: We included 3,184 patients with ischemic stroke (mean age: 71 ± 13.90 years, men: 51.06%). Among the 61 clinical variables included in the model, the National Institutes of Health Stroke Scale score above 24, insert indwelling urinary catheter, hypercoagulable state, and percutaneous gastrostomy had the highest importance score. The Model's AUC (area under the curve) for predicting 30-day readmission was 0.74 (95%CI: 0.64-0.78) with PPV of 0.43 when the XGBoost algorithm was used with ROSE-sampling. The balance between specificity and sensitivity improved through the sampling strategy. The best sensitivity was achieved with LR when optimized with feature selection and ROSE-sampling (AUC: 0.64, sensitivity: 0.53, specificity: 0.69). Conclusions: Machine learning-based models can be designed to predict 30-day readmission after stroke using structured data from EHR. Among the algorithms analyzed, XGBoost with ROSE-sampling had the best performance in terms of AUC while LR with ROSE-sampling and feature selection had the best sensitivity. Clinical variables highly associated with 30-day readmission could be targeted for personalized interventions. Depending on healthcare systems' resources and criteria, models with optimized performance metrics can be implemented to improve outcomes.

Project description:ImportanceAccurate identification of hospital readmission risk during a current hospitalization may enhance decision-making, facilitate targeted systems-level interventions, and avoid preventable readmissions.ObjectiveTo temporally and externally validate a suite of readmission risk prediction models across 48 children's hospitals to assess their generalizability and feasibility for future clinical implementation.Design, setting, and participantsThis prognostic study analyzed data from the Pediatric Health Information System (PHIS) database, which contains billing and resource use data from 48 US children's hospitals, including the derivation hospital (DH) and 47 hospitals participating in the PHIS database (hereafter other PHIS hospitals). Children aged 18 years or younger discharged from these hospitals between January 1, 2016, to December 31, 2019, were included. This cohort was divided as specified into the 3 prediction models at the DH: 6 months or older with no recent hospitalizations (new admission model [NAM]), 6 months or older with 1 or more prior hospitalizations within the last 6 months (recent admission model [RAM]), and 6 months or younger (young infant model [YIM]). Data were analyzed from August 9 to December 1, 2023.Main outcomes and measuresThe primary validation outcome was hospital-level discrimination measured with area under the receiver operating characteristic curve (AUROC). Predictors included demographic, clinical, and utilization variables. All-cause 30-day readmission was modeled for each hospital using logistic regression and parameter estimates from the DH. Calibration plots examined observed vs predicted outcome frequencies for each hospital.ResultsIn external validation, a total of 851 499 children were discharged from 48 hospitals (16 330 DH discharges and 835 169 other PHIS hospital discharges). The largest group of children was aged 5 to 14 years (281 193 [33.0%]). In temporal validation, the DH PHIS 2016-2018 cohort included 45 682 discharges. All-cause 30-day readmission rates were 7.2% for NAM, 35.5% for RAM, and 11.7% for YIM. The 2019 DH PHIS cohort included 16 330 discharges. All cause 30-day readmision rates were 7.2% for NAM, 35.1% for RAM, and 11.1% for YIM. Temporal validation demonstrated reduced discrimination across all 3 models (median AUROC, 0.65 [95% CI 0.62-0.67] for the NAM; 0.73 [95% CI 0.72-0.75) for RAM; 0.67 [95% CI 0.63-0.70) for the YIM compared with the original estimates (median AUROC 0.76 [95% CI 0.85-0.78] for the NAM; 0.84 [95% CI 0.83-0.84] for the RAM; 0.79 [95% CI 0.77-0.80] for the YIM). Overall readmission rates were 5.9% for NAM, 30.1% for RAM, and 7.6% for YIM. External validation yielded similiar findings as the temporal validation, although with demonstrable variation in performance across hospitals (median [range] AUROC, 0.64 [0.60-0.68] for the NAM; 0.73 [0.64-0.80] for the RAM; 0.65 [0.53-0.74] for the YIM). Most hospitals were poorly calibrated, with both significant overestimation and underestimation of observed risk. Of 47 other PHIS hospitals, only 3 for the RAM (6.4%) and 9 for both the NAM and YIM (19.1%) were adequately calibrated.Conclusions and relevanceThis prognostic study found that the readmission risk prediction models had reduced predictive accuracy across time and variability in hospital-level performance. These findings stress the importance of local validation prior to clinical implementation and suggest opportunities to improve generalizability, including multicenter derivation and expansion of candidate predictors.

Dataset Information

Medicare Claim-Based National Institutes of Health Stroke Scale to Predict 30-Day Mortality and Hospital Readmission.

Background

Objective

Design

Patients

Measurements

Results

Limitation

Conclusions

Publications

Medicare Claim-Based National Institutes of Health Stroke Scale to Predict 30-Day Mortality and Hospital Readmission.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets