Dataset Information

The Impact of Trainee and Standardized Patient Race and Gender on Internal Medicine Resident Communication Assessment Scores.

ABSTRACT:

Background

Standardized patient (SP) encounters are commonly used to assess communication skills in medical training. The impact of SP and resident demographics on the standardized communication ratings in residents has not been evaluated.

Objective

To examine the impact of gender and race on SP assessments of internal medicine (IM) residents' communication skills during postgraduate year (PGY) 1.

Methods

We performed a retrospective cohort study of all SP assessments of IM PGY-1 residents for a standardized communication exercise from 2012 to 2018. We performed descriptive analyses of numeric communication SP ratings by gender, race, and age (for residents and SPs). A generalized estimating equation model, clustered on individual SP, was used to determine the association of gender (among SP and residents) with communication ratings. A secondary analysis was performed to determine the impact of residents and SP racial concordance in communication scores.

Results

There were 1356 SP assessments of 379 IM residents (199 male residents [53%] and 178 female residents [47%]). There were significant differences in average numeric communication rating (mean 3.40 vs 3.34, P = .009) by gender of resident, with higher scores in female residents. There were no significant interactions between SP and resident gender across the communication domains. There were no significant interactions noted with racial concordance between interns and SPs.

Conclusions

Our data demonstrate an association of resident gender on ratings in standardized communication exercises, across multiple communication skills. There was not an interaction impact for gender or racial concordance between SPs and interns.

SUBMITTER: Heath JK

PROVIDER: S-EPMC8527939 | biostudies-literature | 2021 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The Impact of Trainee and Standardized Patient Race and Gender on Internal Medicine Resident Communication Assessment Scores.

Heath Janae K JK Dine C Jessica CJ LaMarra Denise D Cardillo Serena S

Journal of graduate medical education 20211015 5

<h4>Background</h4>Standardized patient (SP) encounters are commonly used to assess communication skills in medical training. The impact of SP and resident demographics on the standardized communication ratings in residents has not been evaluated.<h4>Objective</h4>To examine the impact of gender and race on SP assessments of internal medicine (IM) residents' communication skills during postgraduate year (PGY) 1.<h4>Methods</h4>We performed a retrospective cohort study of all SP assessments of IM ...[more]

PMID: 34721792

Similar Datasets

Project description:BackgroundSitting at the bedside may strengthen physician-patient communication and improve patient experience. Yet despite the potential benefits of sitting, hospital physicians, including resident physicians, may not regularly sit down while speaking with patients.ObjectiveTo examine the frequency of sitting by internal medicine residents (including first post-graduate year [PGY-1] and supervising [PGY-2/3] residents) during inpatient encounters and to assess the association between patient-reported sitting at the bedside and patients' perceptions of other physician communication behaviors. We also assessed residents' attitudes towards sitting.DesignIn-person survey of patients and email survey of internal medicine residents between August 2019 and January 2020.ParticipantsPatients admitted to general medicine teaching services and internal medicine residents at The Johns Hopkins Hospital.Main measuresPatient-reported frequency of sitting at the bedside, patients' perceptions of other communication behaviors (e.g., checking for understanding); residents' attitudes regarding sitting.Key resultsOf 334 eligible patients, 256 (76%) completed a survey. Among these 256 respondents, 198 (77%) and 166 (65%) reported recognizing the PGY-1 and PGY-2/3 on their care team, respectively, for a total of 364 completed surveys. On most surveys (203/364, 56%), patients responded that residents "never" sat. Frequent sitting at the bedside ("every single time" or "most of the time," together 48/364, 13%) was correlated with other positive behaviors, including spending enough time at the bedside, checking for understanding, and not seeming to be in a rush (p < 0.01 for all). Of 151 residents, 77 (51%) completed the resident survey; 28 of the 77 (36%) reported sitting frequently. The most commonly cited barrier to sitting was that chairs were not available (38 respondents, 49%).ConclusionsPatients perceived that residents sit infrequently. However, sitting was associated with other positive communication behaviors; this is compatible with the hypothesis that promoting sitting could improve overall patient perceptions of provider communication.

Project description:BackgroundEquitable assessment is critical in competency-based medical education. This study explores differences in key characteristics of qualitative assessments (i.e., narrative comments or assessment feedback) of internal medicine postgraduate resident performance associated with gender and race and ethnicity.MethodsAnalysis of narrative comments included in faculty assessments of resident performance from six internal medicine residency programs was conducted. Content analysis was used to assess two key characteristics of comments- valence (overall positive or negative orientation) and specificity (detailed nature and actionability of comment) - via a blinded, multi-analyst approach. Differences in comment valence and specificity with gender and race and ethnicity were assessed using multilevel regression, controlling for multiple covariates including quantitative competency ratings.ResultsData included 3,383 evaluations with narrative comments by 597 faculty of 698 residents, including 45% of comments about women residents and 13.2% about residents who identified with race and ethnicities underrepresented in medicine. Most comments were moderately specific and positive. Comments about women residents were more positive (estimate 0.06, p 0.045) but less specific (estimate - 0.07, p 0.002) compared to men. Women residents were more likely to receive non-specific, weakly specific or no comments (adjusted OR 1.29, p 0.012) and less likely to receive highly specific comments (adjusted OR 0.71, p 0.003) or comments with specific examples of things done well or areas for growth (adjusted OR 0.74, p 0.003) than men. Gendered differences in comment specificity and valence were most notable early in training. Comment specificity and valence did not differ with resident race and ethnicity (specificity: estimate 0.03, p 0.32; valence: estimate - 0.05, p 0.26) or faculty gender (specificity: estimate 0.06, p 0.15; valence: estimate 0.02 p 0.54).ConclusionThere were significant differences in the specificity and valence of qualitative assessments associated with resident gender with women receiving more praising but less specific and actionable comments. This suggests a lost opportunity for well-rounded assessment feedback to the disadvantage of women.

Project description:IntroductionThe discharge conversation is a critical component of the emergency department encounter. Studies suggest that emergency medicine (EM) residency education is deficient in formally training residents on the patient discharge conversation. Our goal was to assess the proficiency of EM residents in addressing essential elements of a comprehensive discharge conversation; identify which components of the discharge conversation are omitted; introduce "DC HOME," a standardized discharge mnemonic; and determine whether its implementation improved resident performance and patient satisfaction.MethodsThis was a prospective observational pre- and post-intervention study done by convenience sampling of 400 resident discharge encounters. Resident physicians were observed by attending physicians who completed an evaluation, answering "yes" or "no" as to whether residents addressed six components of a comprehensive discharge. The six components include the following: diagnosis; care rendered; health and lifestyle modifications; obstacles after discharge; medications; and expectations - or "DC HOME." Didactics introducing the mnemonic "DC HOME" was provided to resident physicians. Patient feedback and satisfaction were collected after each encounter, and we recorded differences between pre-intervention and post-intervention encounters.ResultsResident physicians improved significantly in all six components of "DC HOME" from pre-and-post intervention: discharge diagnosis (P = 0.0036) and the remaining five components (P<0.0001). There was a statistically significant improvement in patients' perception for health and lifestyle modifications, obstacles after discharge, medications, expectations after discharge (P<0.0001), and discharge diagnosis (P = 0.0029). Patient satisfaction scores improved significantly (P = 0.005). Time spent with patients during discharge increased from 2 minutes and 42 seconds to 4 minutes and 4 seconds (P<0.0001).ConclusionEM residents frequently omit key components of the discharge conversation. The implementation of the "DC HOME" discharge mnemonic improves resident discharge performance, patient perception, and overall patient satisfaction.

Project description:ImportanceThe patient-centered medical home (PCMH) model holds promise for improving primary care delivery, but it has not been adequately tested in teaching settings.Design, setting, and participantsWe implemented an intervention guided by PCMH principles at a safety-net teaching clinic with resident physician providers. Two similar clinics served as controls.Main outcomes and measuresUsing a cross-sectional design, we measured the effect on patient and resident satisfaction using the Consumer Assessment of Healthcare Providers and Systems survey and a validated teaching clinic survey, respectively. Both surveys were conducted at baseline and 1 year after the intervention. We also measured the effect on emergency department and hospital utilization.ResultsFollowing implementation of our intervention, the clinic’s score on the National Committee for Quality Assurance’s PCMH certification tool improved from 35 to 53 of 100 possible points, although our clinic did not achieve all must-pass elements to qualify as a PCMH. During the 1-year study period, 4676 patients were exposed to the intervention; 39.9% of these used at least 1 program component. Compared with baseline, patient-reported access and overall satisfaction improved to a greater extent in the intervention clinic, and the composite satisfaction rating increased from 48% to 65% in the intervention clinic vs from 50% to 59% in the control sites (P = .04). The improvements were particularly notable for questions relating to access. For example, satisfaction with urgent appointment scheduling increased from 12% to 53% in the intervention clinic vs from 14% to 18% in the control clinics (P < .001). Resident satisfaction also improved in the intervention clinic: the composite satisfaction score increased from 39% to 51% in the intervention clinic vs a decrease from 46% to 42% in the control clinics (P = .01). Emergency department utilization did not differ significantly between the intervention and control clinics, and hospitalizations increased from 26 to 27 visits per 1000 patients per month in the intervention clinic vs a decrease from 28 to 25 in the control clinics (P = .02).Conclusions and relevanceOur PCMH-guided intervention, which represented a modest but substantive step toward the PCMH vision, had favorable effects on patient and resident satisfaction at a safety-net teaching clinic but did not reduce emergency department or hospital utilization in the first year. Our experience may provide lessons for other teaching clinics in safety-net settings hoping to implement PCMH-guided reforms.

Project description:ImportanceDespite its importance to medical education and competency assessment for internal medicine trainees, evidence about the relationship between physicians' milestone residency ratings or the American Board of Internal Medicine's initial certification examination and their hospitalized patients' outcomes is sparse.ObjectiveTo examine the association between physicians' milestone ratings and certification examination scores and hospital outcomes for their patients.Design, setting, and participantsRetrospective cohort analyses of 6898 hospitalists completing training in 2016 to 2018 and caring for Medicare fee-for-service beneficiaries during hospitalizations in 2017 to 2019 at US hospitals.Main outcomes and measuresPrimary outcome measures included 7-day mortality and readmission rates. Thirty-day mortality and readmission rates, length of stay, and subspecialist consultation frequency were also assessed. Analyses accounted for hospital fixed effects and adjusted for patient characteristics, physician years of experience, and year.ExposuresCertification examination score quartile and milestone ratings, including an overall core competency rating measure equaling the mean of the end of residency milestone subcompetency ratings categorized as low, medium, or high, and a knowledge core competency measure categorized similarly.ResultsAmong 455 120 hospitalizations, median patient age was 79 years (IQR, 73-86 years), 56.5% of patients were female, 1.9% were Asian, 9.8% were Black, 4.6% were Hispanic, and 81.9% were White. The 7-day mortality and readmission rates were 3.5% (95% CI, 3.4%-3.6%) and 5.6% (95% CI, 5.5%-5.6%), respectively, and were 8.8% (95% CI, 8.7%-8.9%) and 16.6% (95% CI, 16.5%-16.7%) for mortality and readmission at 30 days. Mean length of stay and number of specialty consultations were 3.6 days (95% CI, 3.6-3.6 days) and 1.01 (95% CI, 1.00-1.03), respectively. A high vs low overall or knowledge milestone core competency rating was associated with none of the outcome measures assessed. For example, a high vs low overall core competency rating was associated with a nonsignificant 2.7% increase in 7-day mortality rates (95% CI, -5.2% to 10.6%; P = .51). In contrast, top vs bottom examination score quartile was associated with a significant 8.0% reduction in 7-day mortality rates (95% CI, -13.0% to -3.1%; P = .002) and a 9.3% reduction in 7-day readmission rates (95% CI, -13.0% to -5.7%; P < .001). For 30-day mortality, this association was -3.5% (95% CI, -6.7% to -0.4%; P = .03). Top vs bottom examination score quartile was associated with 2.4% more consultations (95% CI, 0.8%-3.9%; P < .003) but was not associated with length of stay or 30-day readmission rates.Conclusions and relevanceAmong newly trained hospitalists, certification examination score, but not residency milestone ratings, was associated with improved outcomes among hospitalized Medicare beneficiaries.

Dataset Information

The Impact of Trainee and Standardized Patient Race and Gender on Internal Medicine Resident Communication Assessment Scores.

Background

Objective

Methods

Results

Conclusions

Publications

The Impact of Trainee and Standardized Patient Race and Gender on Internal Medicine Resident Communication Assessment Scores.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets