Dataset Information

The problem with dichotomizing quality improvement measures.

ABSTRACT: The Anesthesia Quality Institute (AQI) promotes improvements in clinical care outcomes by managing data entered in the National Anesthesia Clinical Outcomes Registry (NACOR). Each case included in NACOR is classified as "performance met" or "performance not met" and expressed as a percentage for a length of time. The clarity associated with this binary classification is associated with limitations on data analysis and presentations that may not be optimal guides to evaluate the quality of care. High compliance benchmarks present another obstacle for evaluating quality. Traditional approaches for interpreting statistical process control (SPC) charts depend on data points above and below a center line, which may not provide adequate characterizations of a QI process with a low failure rate, or few possible data points below the center line. This article demonstrates the limitations associated with the use of binary datasets to evaluate the quality of care at an individual organization with QI measures, describes a method for characterizing binary data with continuous variables and presents a solution to analyze rare QI events using g charts.

SUBMITTER: Jones JH

PROVIDER: S-EPMC9484068 | biostudies-literature | 2022 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The problem with dichotomizing quality improvement measures.

Jones James Harvey JH Fleming Neal N

BMC anesthesiology 20220919 1

The Anesthesia Quality Institute (AQI) promotes improvements in clinical care outcomes by managing data entered in the National Anesthesia Clinical Outcomes Registry (NACOR). Each case included in NACOR is classified as "performance met" or "performance not met" and expressed as a percentage for a length of time. The clarity associated with this binary classification is associated with limitations on data analysis and presentations that may not be optimal guides to evaluate the quality of care. ...[more]

PMID: 36123624

Similar Datasets

Project description:BackgroundPrevious research addressed the development of a classification scheme for quality improvement systems in European hospitals. In this study we explore associations between the 'maturity' of the hospitals' quality improvement system and clinical outcomes.MethodsThe maturity classification scheme was developed based on survey results from 389 hospitals in eight European countries. We matched the hospitals from the Spanish sample (113 hospitals) with those hospitals participating in a nation-wide, voluntary hospital performance initiative. We then compared sample distributions and explored associations between the 'maturity' of the hospitals' quality improvement system and a range of composite outcomes measures, such as adjusted hospital-wide mortality, -readmission, -complication and -length of stay indices. Statistical analysis includes bivariate correlations for parametrically and non-parametrically distributed data, multiple robust regression models and bootstrapping techniques to obtain confidence-intervals for the correlation and regression estimates.ResultsOverall, 43 hospitals were included. Compared to the original sample of 113, this sample was characterized by a higher representation of university hospitals. Maturity of the quality improvement system was similar, although the matched sample showed less variability. Analysis of associations between the quality improvement system and hospital-wide outcomes suggests significant correlations for the indicator adjusted hospital complications, borderline significance for adjusted hospital readmissions and non-significance for the adjusted hospital mortality and length of stay indicators. These results are confirmed by the bootstrap estimates of the robust regression model after adjusting for hospital characteristics.ConclusionsWe assessed associations between hospitals' quality improvement systems and clinical outcomes. From this data it seems that having a more developed quality improvement system is associated with lower rates of adjusted hospital complications. A number of methodological and logistic hurdles remain to link hospital quality improvement systems to outcomes. Further research should aim at identifying the latent dimensions of quality improvement systems that predict quality and safety outcomes. Such research would add pertinent knowledge regarding the implementation of organizational strategies related with quality of care outcomes.

Project description:Studies on inflammatory bowel disease (IBD) have reported suboptimal approaches to patient care. In the United States, the findings have motivated leading gastroenterology organizations to call for initiatives that support clinicians in aligning their practices with quality measures for IBD and priorities of the National Quality Strategy (NQS). We designed and implemented a quality improvement (QI) education program on ulcerative colitis in which patient charts were audited for 30 gastroenterologists before (n = 300 charts) and after (n = 290 charts) they participated in QI-focused educational activities. Charts were audited for nine measures, selected for their alignment with four NQS priorities: making care safer, ensuring patient engagement, promoting communication, and promoting effective treatment practices. Four of the measures, including guideline-directed vaccinations and assessments of disease type and activity, were part of the CMS Physician Quality Reporting System (PQRS). The other five measures involved counseling patients on various topics in ulcerative colitis management, documentation of side effects, assessment of adherence status, and simplification of dosing. The gastroenterologists also completed baseline and post-education surveys designed to assess qualitative outcomes. One of the educational interventions was a private audit feedback session conducted for each gastroenterologist. The sessions were designed to support participants in identifying measures reflecting suboptimal care quality and developing action plans for improvement. In continuous improvement cycles, follow-up interventions included QI tools and educational monographs. Across the nine chart variables, post-education improvements ranged from 0% to 48%, with a mean improvement of 15.9%. Survey findings revealed improvements in self-reported understanding of quality measures and intentions to apply them to practice, and lower rates of perceived significant barriers to high-quality care. The findings indicate the potential for QI education to support gastroenterologists in improving their performance on key measures of care quality for patients with ulcerative colitis.

Dataset Information

The problem with dichotomizing quality improvement measures.

Publications

The problem with dichotomizing quality improvement measures.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets