Building capacity for quality: a pilot co-learning curriculum in quality improvement for faculty and resident learners.
Ontology highlight
ABSTRACT: BACKGROUND: Despite a mandate to teach quality improvement (QI) to residents, many training programs lack faculty capacity to deliver a QI curriculum. OBJECTIVE: We piloted a co-learning curriculum in QI to train residents while simultaneously developing QI teachers. We evaluated the curriculum's acceptability and feasibility and its effect on faculty engagement in doing and teaching QI. METHODS: The curriculum involved 2 half-day, interactive sessions, a team-based QI project, and end-of-year project presentations. Key curriculum design principles included (1) residents and faculty co-attend all interactive sessions, (2) residents and faculty work together on team-based QI projects, and (3) QI projects align with divisional QI priorities. Using the Kirkpatrick framework for learner outcomes, we focused our program evaluation on Level 1 (satisfaction) and Level 2 (knowledge and skills acquisition) outcomes using year-end curriculum evaluations. RESULTS: Our study included 14 residents (70%) and 6 faculty members (30%). With respect to satisfaction (Kirkpatrick Level 1 outcome), 93% (13 of 14) of residents and 100% (6 of 6) of faculty participants rated the overall curriculum as "above average" or "outstanding." Regarding faculty knowledge and skills acquisition (Kirkpatrick Level 2 outcomes), faculty self-rated their QI knowledge and interest in QI higher than their intent to incorporate QI into future practice and their comfort in teaching or supervising QI projects. All 5 faculty respondents (100%) rated the co-learning model for faculty development in QI as "above average" or "outstanding." CONCLUSIONS: Teaching QI to residents and faculty as co-learners is feasible and acceptable and offers a promising model for programs to teach QI to residents while concurrently building faculty capacity.
Project description:IntroductionQuality improvement (QI) training is an essential component of resident medical education and a part of the ACGME core competencies. We present our residency's evidence-based QI curriculum, which outlines key components identified in the literature for successful QI education.MethodsOur curriculum included a mandatory five-part longitudinal educational series during ambulatory education sessions for second-year residents. Modeled after the Institute for Healthcare Improvement model for improvement and taught by a chief resident, our curriculum introduced residents to key QI concepts through case-based, just-in-time didactics and applied experiential learning via concurrent resident-led longitudinal QI projects. Residents received structured, multilayer mentorship from a faculty mentor in their field of interest and the chief resident of quality and patient safety. Their work-in-progress projects were presented to faculty QI experts and institutional leadership for additional feedback and mentorship.ResultsSince 2016, a total of 234 internal medicine residents have completed our QI curriculum and developed 67 QI projects, which have been presented at various local, regional, and national conferences. In the 2 most recent academic years, Quality Improvement Knowledge Application Tool Revised (QIKAT-R) scores significantly increased from 4.6 precurriculum to 6.3 postcurriculum (p < .001).DiscussionA longitudinal, experiential, and mentored QI curriculum teaches residents QI skill sets through incorporating mechanisms associated with successful educational initiatives and adult learning theory. Our QIKAT-R results and project output show that our curriculum is associated with improved trainee QI knowledge and systems-level improvements.
Project description:BackgroundQuality improvement (QI) skills are learned during residency, yet there are few reports of the scholarly activity outcomes of a QI curriculum in a primary care program.InterventionWe examined whether scholarly activity can result from a longitudinal, experiential QI curriculum that involves residents, clinic staff, and faculty.MethodsThe University of Pittsburgh Medical Center Shadyside Family Medicine Residency implemented a required longitudinal outpatient practice improvement rotation (LOPIR) curriculum in 2005. The rotation format includes weekly multidisciplinary work group meetings alternating with resident presentations delivered to the entire program. Residents present the results of a literature review and provide 2 interim project updates to the residency. A completed individual project is required for residency graduation, with project results presented at Residency Research Day. Scholarly activity outcomes of the curriculum were analyzed using descriptive statistics.ResultsAs of 2014, 60 residents completed 3 years of the LOPIR curriculum. All residents satisfied the 2014 Accreditation Council for Graduate Medical Education (ACGME) scholarly activity and QI requirements with a literature review presentation in postgraduate year 2, and the presentation of a completed QI project at Residency Research Day. Residents have delivered 83 local presentations, 13 state/regional presentations, and 2 national presentations. Residents received 7 awards for QI posters, as well as 3 grants totaling $21,639. The educational program required no additional curriculum time, few resources, and was acceptable to residents, faculty, and staff.ConclusionsLOPIR is an effective way to meet and exceed the 2014 ACGME scholarly activity requirements for family medicine residents.
Project description:IntroductionPatient safety and quality improvement are essential components of modern medicine. The traditional model of graduate medical education does not lend itself well to learning these disciplines. This curriculum encompasses these disciplines across multiple modalities and extends throughout residency.MethodsThe curriculum includes introductory presentations suitable for naive audiences. Following these is a structured rotation that provides the opportunity both to experience in-depth self-directed learning and to practice skills involved in quality and safety. This rotation includes existing online courses published elsewhere, reflective writing exercises based on self-directed learning, and practice cases. Finally, residents lead a morbidity, mortality, and improvement conference where adverse events are identified and reviewed, specific interventions and outcome objectives are selected, and action teams are identified.ResultsAfter two presentations on system issues and individual issues, responses to the prompt "This talk will aid in my professional development" were 4.75 and 4.59 out of 5, respectively. Eighty-three percent of residents agreed they had a better understanding of the concepts of patient safety and/or quality improvement than they did before the rotation. Audience members for the resident-led morbidity, mortality, and improvement conference agreed it would lead to a change in their own practice.DiscussionThe contents of this longitudinal curriculum have been incorporated into the core requirements of our general pediatrics residency program and could reasonably be imported into any residency requiring a robust longitudinal experience in quality improvement and patient safety.
Project description:IntroductionPractice patterns in clinical learning environments are an important predictor of the patient care quality that residents will deliver after training. The Accreditation Council for Graduate Medical Education (ACGME) Clinical Learning Environment Review Evaluation Committee reported that from 2012-2015, residents and fellows rarely engaged in quality improvement (QI) activities. A QI curriculum was created for OB-GYN faculty and trainees to develop and implement best practices and study the resulting improvement in patient outcomes.MethodsEducational leadership in the Dell Medical School Department of Women's Health designed a five-stage curriculum: (1) learning module describing the curriculum's rationale, (2) clinical practice proposal development, (3) implementation/data analysis for selected proposals, (4) dissemination of proposals and outcomes during a live forum, and (5) evaluation. PGY1 and PGY4 OB-GYN residents collaborated in dyads with selected faculty mentors to draft evidence-based proposals. Dyads identified suggested outcomes measures to be analyzed postimplementation. Remaining faculty analyzed outcomes from the previous year's proposals with PGY2 and PGY3 OB-GYN residents.ResultsForum participants, including faculty, residents, nursing staff, and private obstetrician-gynecologists, evaluated the activity. In 2017, 15 (35%) completed the evaluation. All respondents intended to change their practice based on findings. In addition, the 2016 ACGME survey indicated significant increases in faculty perception of resident QI from 58% in 2014-2015 to 89% in 2015-2016 (p = .01) and in collaboration in scholarly activity from 50% to 85% (p < .01).DiscussionThis curriculum was effective in engaging OB-GYN faculty and residents in formalized problem-based learning to address QI.
Project description:BackgroundThe ability of health professions faculty to design, teach, evaluate, and improve relevant curricula is vital for teaching improvement science (IS) skills to trainees.ObjectiveWe launched a Foundational Improvement Science Curriculum (FISC) to build faculty competence in IS teaching and scholarship, and to develop, expand, and standardize IS curricula across one institution.MethodsFISC consisted of 9 full or half-day sessions over 10 months in 2015-2016 and 2016-2017 academic years. Each session required pre-work, including readings, Institute for Healthcare Improvement Open School modules, and personal improvement projects. Sessions included brief didactics, group activities, planning, and feedback on curriculum development. An evaluation strategy was employed, including pre- and post-program self-assessment, competency mapping, evaluations of didactics and overall program, and participant satisfaction.ResultsForty individuals from 23 academic programs voluntarily completed FISC, representing 20% of graduate medical education (GME) programs and 50% of primary GME programs in addition to undergraduate medical education (UME) and nursing programs. Median self-assessed competency scores (mid versus final score; scale 1-9, 9 high; P < .05 for all comparisons) improved over the course for all competencies for knowledge (3 versus 7), application (2 versus 7), curriculum design (2 versus 7), and scholarship (2 versus 5). Eighteen new or revised IS curricula were developed across GME, UME, and nursing programs.ConclusionsFISC offers a feasible model to enhance and support faculty development in IS and IS curriculum design.
Project description:BackgroundQuality improvement (QI) is essential in clinical practice, requiring effective teaching in residency. Barriers include lack of structure, mentorship, and time.ObjectiveTo develop a longitudinal QI curriculum for an internal medicine residency program with limited faculty resources and evaluate its effectiveness.MethodsAll medicine residents were provided with dedicated research time every 8 weeks during their ambulatory blocks. Groups of 3 to 5 residents across all postgraduate year levels were formed. Two faculty members and 1 chief resident advised all groups, meeting with each group every 8 weeks, with concrete expectations for each meeting. Residents were required to complete didactic modules from the Institute for Healthcare Improvement. Current residents and alumni were surveyed for feedback.ResultsOver 3 years, all eligible residents (92 residents per year in 2012-2014, 102 in 2014-2015) participated in the curriculum. Residents worked on 54 quality assessment and 18 QI projects, with 6 QI projects showing statistically significant indicator improvements. About 50 mentoring hours per year were contributed by 2 faculty advisors and a chief resident. No other staff or IT support was needed. A total of 69 posters/abstracts were produced, with 13 projects presented at national or regional conferences. Survey respondents found the program useful; most (75% residents, 63% alumni) reported it changed their practice, and 71% of alumni found it useful after residency.ConclusionsOur longitudinal QI curriculum requires minimal faculty time and resulted in increased QI-related publications and measurable improvements in quality indicators. Alumni reported a positive effect on practice after graduation.
Project description:BackgroundResident participation in quality improvement and patient safety (QIPS) programs is an essential training experience and Accreditation Council for Graduate Medical Education requirement. However, the most effective approach to achieve this is unclear.ObjectiveWe developed an experiential Quality Improvement and Patient Safety Curriculum and Resident Experience (QIPS CURE) program, which provides internal medicine (IM) residents with foundational QIPS knowledge, and evaluated its effectiveness.MethodsAfter reviewing IM residency QIPS curricula and obtaining input from institutional stakeholders in 2013-2014, we launched a longitudinal QIPS curriculum for all 66 postgraduate year 1-3 IM residents in July 2014. The QIPS CURE included 2 major elements: didactics, delivered through a variety of sources, including online modules and workshops, and hands-on projects. We delivered this curriculum annually from 2014 to 2018. We used project completion and an attitude survey of participants to evaluate it.ResultsSix projects were completed in 2014-2015, and 10 projects completed yearly for the next 3 academic years. Residents presented all projects at regional meetings. Surveyed residents reported improvement in understanding (M = 5.71, SD = 1.07 pre- to M = 6.38, SD = 0.49 post-curriculum, P = .013) and competence (M = 3.31, SD = 1.18 pre- to M = 6.08, SD = 0.77, post-curriculum, P < .001) when comparing graduates of the curriculum with incoming interns. Qualitative analysis revealed perceived acquisition of skills needed to carry out successful QIPS projects.ConclusionsThis QIPS program was sustainable over 4 years and generally well-received by residents, with many projects completed each year.
Project description:IntroductionParticipation in quality improvement (QI) projects is required of pediatric residents, and evidence-based medicine has highlighted the importance of providing residents with experiential practice in this realm. Embedding QI projects within a continuity clinic provides residents an opportunity for meaningful involvement in QI efforts.MethodsA QI curriculum was implemented within a pediatric residency program that included an introductory lecture on QI principles and participation in resident-led, team-based QI projects at an outpatient clinic. Residents designed, implemented, and analyzed projects beginning in their intern year. Projects operated on an accelerated, 6-month time frame, allowing residents to complete multiple projects over the course of their residency. Resident QI knowledge was assessed before and after an introductory lecture with the Quality Improvement Knowledge Application Tool (QIKAT). Resident feedback was solicited 1 year following curriculum implementation via anonymous online surveys.ResultsResidents completed four QI projects that produced meaningful improvements in clinic processes and patient care. QIKAT scores significantly increased after the introductory lecture. Residents reported that the curriculum afforded them increased confidence to implement plan-do-study-act cycles and improve patient care in their future practices. Qualitative feedback highlighted the team-based structure, participation in multiple projects, and visible direct impacts on patient care as strengths of the curriculum. Increased involvement of clinic staff, scheduling concerns, and improved communication were areas for improvement.DiscussionOur model for integrating resident-led QI projects into an ambulatory clinic rotation is feasible and has been well received by residents and impactful on clinic processes and care.
Project description:BackgroundThe extent that organizational learning and resilience for the change process, that is, adaptive reserve (AR), is a component of building practice capacity for continuous quality improvement (QI) is unknown.PurposeThe aim of the study was to examine the association of AR and development of QI capacity.MethodologyOne hundred forty-two primary care practices were evaluated at baseline and 12 months in a randomized trial to improve care quality. Practice AR was measured by staff survey along with a validated QI capacity assessment (QICA). We assessed the association of baseline QICA with baseline AR and both baseline and change in AR with change in QICA from 0 to 12 months. Effect modification by presence of QI infrastructure in parent organizations and trial arm was examined.ResultsMean QICA increased from 6.5 to 8.1 (p < .001), and mean AR increased from 71.8 to 73.9 points (p < .001). At baseline, there was a significant association between AR and QICA scores: The QICA averaged 0.34 points higher (95% CI [0.04, 0.64], p = .03) per 10-point difference in AR. There was a significant association between baseline AR and 12-month QICA-which averaged 0.30 points higher (95% CI [0.02, 0.57], p = .04) per 10 points in baseline AR. There was no association between changes in AR and the QICA from 0 to 12 months and no effect modification by trial arm or external QI infrastructure.ConclusionsBaseline AR was positively associated with both baseline and follow-up QI capacity, but there was no association between change in AR and change in the QICA, suggesting AR may be a precondition to growth in QI capacity.Practice implicationsFindings suggest that developing AR may be a valuable step prior to undertaking QI-oriented growth, with implications for sequencing of development strategies, including added gain in QI capacity development from building AR prior to engaging in transformation efforts.
Project description:ContextContinuous quality improvement (CQI) has become prominent in public health settings; yet, little consolidated guidance exists for building CQI capacity of community-based organizations.ObjectiveTo synthesize relevant literature to identify guiding principles and core components critical to building the capacity of organizations to adopt and use CQI.DesignWe employed a systematic review approach to assess guiding principles and core components for CQI capacity-building as outlined in the literature.Eligibility criteriaStudies meeting the following criteria were eligible for review: (1) empirical, peer-reviewed journal article, evaluation study, review, or systematic review; (2) published in 2010 or later; and (3) capacity-building activities were described in enough detail to be replicable. Studies not including human subjects, published in a language other than English, or for which full text was not available were excluded.Study selectionThe initial return of records included 6557 articles, of which 1455 were duplicates. The research team single-screened titles and abstracts of 5102 studies, resulting in the exclusion of 4842 studies. Two hundred sixty-two studies were double-screened during full-text review, yielding a final sample of 61 studies from which data were extracted.Main outcome measuresOutcome measures of interest were operationalized descriptions of guiding principles and core components of the CQI capacity-building approach.ResultsResults yielded articles from medical education, health care, and public health settings. Findings included guiding principles and core components of CQI capacity-building identified in current practice, as well as infrastructural and contextual elements needed to build CQI capacity.ConclusionsThis consolidation of guiding principles and core components for CQI capacity-building is valuable for public health and related workforces. Despite the uneven distribution of articles from health care, medical education, and public health settings, our findings can be used to guide public health organizations in building CQI capacity in a well-informed, systematic manner.