Dataset Information

Use of Entrustable Professional Activities in the Assessment of Surgical Resident Competency.

ABSTRACT:

Importance

Competency-based assessments of surgical resident performance require metrics of entrustable autonomy.

Objectives

To designate entrustable professional activities (EPAs) in global performance and in specific operations, and to identify differences in perceived capability, autonomy, and expectations between surgical faculty and residents.

Design, setting, and participants

This survey study was conducted from August 9, 2016, through August 24, 2016, in the Department of Surgery at the UCLA David Geffen School of Medicine. The survey instrument consisted of 5-point Likert scales for assessing perceptions of entrustability for 5 global and 5 operative EPAs. Faculty members were surveyed regarding resident capabilities and expected capabilities by postgraduate year. Residents were surveyed regarding their own capabilities, actual autonomy entrusted in the last EPA performed, and expected capabilities.

Main outcomes and measures

Differences in mean ratings were assessed across 7 comparison domains.

Results

Among 78 total faculty members, 31 (40%) participated in the survey. Among 49 residents, 39 (80%) participated in the survey. Residents generally rated their global EPA performance higher than the faculty did (mean, 3.7 vs 2.8; P < .01), but operative EPA performance ratings were equivalent (mean, 2.7 vs 2.4; P < .12). Faculty members perceived senior residents as underperforming expectations in operative EPAs. Most faculty members (80%) expected residents not to be independently capable of performing complex operations by graduation. Faculty members perceived residents in postgraduate years 4 and 5 to have greater operative capability than the level of autonomy entrusted to those residents (95% CI, 3.3-3.5 vs 1.9-2.2).

Conclusions and relevance

Global and operative EPAs are practical for developing competency-based curricula. Graduated autonomy should be granted to improve the operative experience for residents.

SUBMITTER: Wagner JP

PROVIDER: S-EPMC5933400 | biostudies-literature | 2018 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Use of Entrustable Professional Activities in the Assessment of Surgical Resident Competency.

Wagner Justin P JP Lewis Catherine E CE Tillou Areti A Agopian Vatche G VG Quach Chi C Donahue Timothy R TR Hines O Joe OJ

JAMA surgery 20180401 4

<h4>Importance</h4>Competency-based assessments of surgical resident performance require metrics of entrustable autonomy.<h4>Objectives</h4>To designate entrustable professional activities (EPAs) in global performance and in specific operations, and to identify differences in perceived capability, autonomy, and expectations between surgical faculty and residents.<h4>Design, setting, and participants</h4>This survey study was conducted from August 9, 2016, through August 24, 2016, in the Departme ...[more]

PMID: 29141086

Similar Datasets

Project description:Importance:Entrustable professional activities (EPAs) are an emerging workplace-based, patient-oriented assessment approach with limited empirical evidence. Objective:To measure the development of pediatric trainees' clinical skills over time using EPA-based assessment data. Design, Setting, and Participants:Prospective cohort study of categorical pediatric residents over 3 academic years (2015-2016, 2016-2017, and 2017-2018) assessed on 17 American Board of Pediatrics EPAs. Residents in training at 23 pediatric residency programs in the Association of Pediatric Program Directors Longitudinal Educational Assessment Research Network were included. Assessment was conducted by clinical competency committee members, who made summative assessment decisions regarding levels of supervision required for each resident and each EPA. Data were collected from May 2016 to November 2018 and analyzed from November to December 2018. Interventions:Longitudinal, prospective assessment using EPAs. Main Outcomes and Measures:Trajectories of supervision levels by EPA during residency training and how often graduating residents were deemed ready for unsupervised practice in each EPA. Results:Across the 5 data collection cycles, 1987 residents from all 3 postgraduate years in 23 residency programs were assigned 25 503 supervision level reports for the 17 general pediatrics EPAs. The 4 EPAs that required the most supervision across training were EPA 14 (quality improvement) on the 5-level scale (estimated mean level at graduation, 3.7; 95% CI, 3.6-3.7) and EPAs 8 (transition to adult care; mean, 7.0; 95% CI, 7.0-7.1), 9 (behavioral and mental health; mean, 6.6; 95% CI, 6.5-6.6), and 10 (resuscitate and stabilize; mean, 6.9; 95% CI, 6.8-7.0) on the expanded 5-level scale. At the time of graduation (36 months), the percentage of trainees who were rated at a supervision level corresponding to "unsupervised practice" varied by EPA from 53% to 98%. If performance standards were set to align with 90% of trainees achieving the level of unsupervised practice, this standard would be met for only 8 of the 17 EPAs (although 89% met this standard for EPA 17, performing the common procedures of the general pediatrician). Conclusions and Relevance:This study presents initial evidence for empirically derived practice readiness and sets the stage for identifying curricular gaps that contribute to discrepancy between observed practice readiness and standards needed to produce physicians able to meet the health needs of the patient populations they serve. Future work should compare these findings with postgraduation outcomes data as a means of seeking validity evidence.

Project description:Entrustable professional activity (EPA) is a tool for comprehensively evaluating the level of confidence in resident performances across various competencies in medicine. The application of and attitudes towards EPAs in radiology across the European Society of Radiology (ESR) national institutional member societies is still to be determined. An online survey was conducted among ESR national institutional member societies to assess the current use of EPAs and other resident assessment forms among different countries.Although the primary focus was on the use of EPAs, additional questions also addressed the adherence of training programs to the European Training Curriculum (ETC), other methods of continuous assessment, and examinations. A total of 65 responses were received from 38 countries (81% response rate among national institutional member societies). EPAs were being used in radiology in 21% of countries and planned to be used in 26%. Most responders considered EPAs suitable for radiology and, regarding the future, preferred European-level guidelines on EPAs over national or institutional levels. The majority (63%) of national training programs were reported to be similar to or following the content of the ETC, and the majority (95%) of countries rated the requirements of the European Training Curriculum (ETC) to be adequate. In conclusion, EPAs are beginning to be used in radiology resident training programs across Europe, and their use is expected to increase. There seems to be a positive attitude toward using EPAs in radiology and toward a common European framework.Critical relevance statement As a result of this survey, we found positive attitudes towards using entrustable professional activities (EPA) in radiology among the institutional member societies of the European Society of Radiology (ESR).Key points• Twenty-one percent of national member societies use entrustable professional activities (EPA) in radiology.• There is a positive attitude toward using EPAs in radiology.• Majority of respondents preferred a common European framework for EPAs.• Majority of radiology training curricula adhere to the European Training Curriculum (ETC).

Project description:PurposeAs global health education and training shift toward competency-based approaches, academic institutions and organizations must define appropriate assessment strategies for use across health professions. The authors aim to develop entrustable professional activities (EPAs) for global health to apply across academic and workplace settings.MethodIn 2019, the authors invited 55 global health experts from medicine, nursing, pharmacy, and public health to participate in a multiround, online Delphi process; 30 (55%) agreed. Experts averaged 17 years of global health experience, and 12 (40%) were from low- to middle-income countries. In round one, participants listed essential global health activities. The authors used in vivo coding for round one responses to develop initial EPA statements. In subsequent rounds, participants used 5-point Likert-type scales to evaluate EPA statements for importance and relevance to global health across health professions. The authors elevated statements that were rated 4 (important/relevant to most) or 5 (very important/relevant to all) by a minimum of 70% of participants (decided a priori) to the final round, during which participants evaluated whether each statement represented an observable unit of work that could be assigned to a trainee. Descriptive statistics were used for quantitative data analysis. The authors used participant comments to categorize EPA statements into role domains.ResultsTwenty-two EPA statements reached at least 70% consensus. The authors categorized these into 5 role domains: partnership developer, capacity builder, data analyzer, equity advocate, and health promoter. Statements in the equity advocate and partnership developer domains had the highest agreement for importance and relevance. Several statements achieved 100% agreement as a unit of work but achieved lower levels of agreement regarding their observability.ConclusionsEPAs for global health may be useful to academic institutions and other organizations to guide the assessment of trainees within education and training programs across health professions.

Dataset Information

Use of Entrustable Professional Activities in the Assessment of Surgical Resident Competency.

Importance

Objectives

Design, setting, and participants

Main outcomes and measures

Results

Conclusions and relevance

Publications

Use of Entrustable Professional Activities in the Assessment of Surgical Resident Competency.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets