Dataset Information

A mixed-method approach to generate and deliver rapid-cycle evaluation feedback: lessons learned from a multicenter implementation trial in pediatric surgery.

ABSTRACT:

Background

Rapid-cycle feedback loops provide timely information and actionable feedback to healthcare organizations to accelerate implementation of interventions. We aimed to (1) describe a mixed-method approach for generating and delivering rapid-cycle feedback and (2) explore key lessons learned while implementing an enhanced recovery protocol (ERP) across 18 pediatric surgery centers.

Methods

All centers are members of the Pediatric Surgery Research Collaborative (PedSRC, www.pedsrc.org ), participating in the ENhanced Recovery In CHildren Undergoing Surgery (ENRICH-US) trial. To assess implementation efforts, we conducted a mixed-method sequential explanatory study, administering surveys and follow-up interviews with each center's implementation team 6 and 12 months following implementation. Along with detailed notetaking and iterative discussion within our team, we used these data to generate and deliver a center-specific implementation report card to each center. Report cards used a traffic light approach to quickly visualize implementation status (green = excellent; yellow = needs improvement; red = needs significant improvement) and summarized strengths and opportunities at each timepoint.

Results

We identified several benefits, challenges, and practical considerations for assessing implementation and using rapid-cycle feedback among pediatric surgery centers. Regarding potential benefits, this approach enabled us to quickly understand variation in implementation and corresponding needs across centers. It allowed us to efficiently provide actionable feedback to centers about implementation. Engaging consistently with center-specific implementation teams also helped facilitate partnerships between centers and the research team. Regarding potential challenges, research teams must still allocate substantial resources to provide feedback rapidly. Additionally, discussions and consensus are needed across team members about the content of center-specific feedback. Practical considerations include carefully balancing timeliness and comprehensiveness when delivering rapid-cycle feedback. In pediatric surgery, moreover, it is essential to actively engage all key stakeholders (including physicians, nurses, patients, caregivers, etc.) and adopt an iterative, reflexive approach in providing feedback.

Conclusion

From a methodological perspective, we identified three key lessons: (1) using a rapid, mixed method evaluation approach is feasible in pediatric surgery and (2) can be beneficial, particularly in quickly understanding variation in implementation across centers; however, (3) there is a need to address several methodological challenges and considerations, particularly in balancing the timeliness and comprehensiveness of feedback.

Trial registration

NIH National Library of Medicine Clinical Trials.

Clinicaltrials

gov Identifier: NCT04060303. Registered August 7, 2019, https://clinicaltrials.gov/ct2/show/NCT04060303.

SUBMITTER: Balbale SN

PROVIDER: S-EPMC10354935 | biostudies-literature | 2023 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A mixed-method approach to generate and deliver rapid-cycle evaluation feedback: lessons learned from a multicenter implementation trial in pediatric surgery.

Balbale Salva N SN Schäfer Willemijn L A WLA Davis Teaniese L TL Blake Sarah C SC Close Sharron S Sullivan Gwyneth A GA Reiter Audra J AJ Hu Andrew J AJ Smith Charesa J CJ Wilberding Maxwell J MJ Johnson Julie K JK Holl Jane L JL Raval Mehul V MV

Implementation science communications 20230718 1

<h4>Background</h4>Rapid-cycle feedback loops provide timely information and actionable feedback to healthcare organizations to accelerate implementation of interventions. We aimed to (1) describe a mixed-method approach for generating and delivering rapid-cycle feedback and (2) explore key lessons learned while implementing an enhanced recovery protocol (ERP) across 18 pediatric surgery centers.<h4>Methods</h4>All centers are members of the Pediatric Surgery Research Collaborative (PedSRC, www. ...[more]

PMID: 37464448

Similar Datasets

Project description:IntroductionFor children who present to emergency departments (EDs) due to blunt head trauma, ED clinicians must decide who requires computed tomography (CT) scanning to evaluate for traumatic brain injury (TBI). The Pediatric Emergency Care Applied Research Network (PECARN) derived and validated two age-based prediction rules to identify children at very low risk of clinically-important traumatic brain injuries (ciTBIs) who do not typically require CT scans. In this case report, we describe the strategy used to implement the PECARN TBI prediction rules via electronic health record (EHR) clinical decision support (CDS) as the intervention in a multicenter clinical trial.MethodsThirteen EDs participated in this trial. The 10 sites receiving the CDS intervention used the Epic(®) EHR. All sites implementing EHR-based CDS built the rules by using the vendor's CDS engine. Based on a sociotechnical analysis, we designed the CDS so that recommendations could be displayed immediately after any provider entered prediction rule data. One central site developed and tested the intervention package to be exported to other sites. The intervention package included a clinical trial alert, an electronic data collection form, the CDS rules and the format for recommendations.ResultsThe original PECARN head trauma prediction rules were derived from physician documentation while this pragmatic trial led each site to customize their workflows and allow multiple different providers to complete the head trauma assessments. These differences in workflows led to varying completion rates across sites as well as differences in the types of providers completing the electronic data form. Site variation in internal change management processes made it challenging to maintain the same rigor across all sites. This led to downstream effects when data reports were developed.ConclusionsThe process of a centralized build and export of a CDS system in one commercial EHR system successfully supported a multicenter clinical trial.

Project description:BackgroundMany large-scale cardiovascular clinical trials are plagued with escalating costs and low enrollment. Implementing a computable phenotype, which is a set of executable algorithms, to identify a group of clinical characteristics derivable from electronic health records or administrative claims records, is essential to successful recruitment in large-scale pragmatic clinical trials. This methods paper provides an overview of the development and implementation of a computable phenotype in ADAPTABLE (Aspirin Dosing: a Patient-Centric Trial Assessing Benefits and Long-Term Effectiveness)-a pragmatic, randomized, open-label clinical trial testing the optimal dose of aspirin for secondary prevention of atherosclerotic cardiovascular disease events.Methods and resultsA multidisciplinary team developed and tested the computable phenotype to identify adults ≥18 years of age with a history of atherosclerotic cardiovascular disease without safety concerns around using aspirin and meeting trial eligibility criteria. Using the computable phenotype, investigators identified over 650 000 potentially eligible patients from the 40 participating sites from Patient-Centered Outcomes Research Network-a network of Clinical Data Research Networks, Patient-Powered Research Networks, and Health Plan Research Networks. Leveraging diverse recruitment methods, sites enrolled 15 076 participants from April 2016 to June 2019. During the process of developing and implementing the ADAPTABLE computable phenotype, several key lessons were learned. The accuracy and utility of a computable phenotype are dependent on the quality of the source data, which can be variable even with a common data model. Local validation and modification were required based on site factors, such as recruitment strategies, data quality, and local coding patterns. Sustained collaboration among a diverse team of researchers is needed during computable phenotype development and implementation.ConclusionsThe ADAPTABLE computable phenotype served as an efficient method to recruit patients in a multisite pragmatic clinical trial. This process of development and implementation will be informative for future large-scale, pragmatic clinical trials. Registration: URL: https://www.clinicaltrials.gov; Unique identifier: NCT02697916.

Project description:BackgroundIn pediatric intensive care, prescription, administration, and interpretation of drug doses are weight dependent. The use of standardized concentrations simplifies the preparation of drugs and increases safety. For safe administration as well as easy interpretation of intravenous drug dosing regimens with standardized concentrations, the display of weight-related dose rates on the infusion device is of pivotal significance.ObjectivesWe report on challenges in the implementation of a new information technology-supported medication workflow. The workflow was introduced on eight beds in the pediatric heart surgery intensive care unit as well as in the pediatric anesthesia at the University of Bonn Medical Center. The proposed workflow utilizes medication labels generated from prescription data from the electronic health record. The generated labels include a two-dimensional barcode to transfer data to the infusion devices.MethodsClinical and technical processes were agilely developed. The reliability of the system under real-life conditions was monitored. User satisfaction and potential for improvement were assessed. In addition, a structured survey among the nursing staff was performed. The questionnaire addressed usability as well as the end-users' perception of the effects on patient safety.ResultsThe workflow has been applied 44,111 times during the pilot phase. A total of 114 known failures in the technical infrastructure were observed. The survey showed good ratings for usability and safety (median "school grade" 2 or B for patient safety, intelligibility, patient identification, and handling). The medical management of the involved acute care facilities rated the process as clearly beneficial regarding patient safety, suggesting a rollout to all pediatric intensive care areas.ConclusionA medical information technology-supported medication workflow can increase user satisfaction and patient safety as perceived by the clinical end-users in pediatric acute care. The successful implementation benefits from an interdisciplinary team, active investigation of possible associated risks, and technical redundancy.

Project description:BackgroundImproving respectful maternity care (RMC) is a recommended practice during childbirth as a strategy to eliminate the mistreatment of women and improve maternal health. There is limited evidence on the effectiveness of RMC interventions and implementation challenges, especially in low-resource settings. This study describes lessons learned in RMC training and its implementation from the perspectives of service providers' perceptions and experiences.MethodsOur mixed methods study employed a pre- and post-intervention quantitative survey of training participants to assess their perceptions of RMC and focus group discussions, two months following the intervention, investigated the experiences of implementing RMC within birthing facilities. The intervention was a three-day RMC training offered to 64 service providers from three hospitals in southern Ethiopia. We performed McNemar's test to analyse differences in participants' perceptions of RMC before and after the training. The qualitative data were analysed using hybrid thematic analysis. Integration of the quantitative and qualitative methods was done throughout the design, analysis and reporting of the study.ResultsMistreatment of women during childbirth was widely reported by participants, including witnessing examinations without privacy (39.1%), and use of physical force (21.9%) within the previous 30 days. Additionally, 29.7% of participants reported they had mistreated a woman. The training improved the participants' awareness of the rights of women during childbirth and their perceptions and attitudes about RMC were positively influenced. However, participants believed that the RMC training did not address providers' rights. Structural and systemic issues were the main challenges providers reported when trying to implement RMC in their contexts.ConclusionTraining alone is insufficient to improve the provision of RMC unless RMC is addressed through a lens of health systems strengthening that addresses the bottlenecks, including the rights of providers of childbirth care.

Dataset Information

A mixed-method approach to generate and deliver rapid-cycle evaluation feedback: lessons learned from a multicenter implementation trial in pediatric surgery.

Background

Methods

Results

Conclusion

Trial registration

Clinicaltrials

Publications

A mixed-method approach to generate and deliver rapid-cycle evaluation feedback: lessons learned from a multicenter implementation trial in pediatric surgery.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets