Dataset Information

The Context of "Confidence": Analyzing the Term Confidence in Resident Evaluations.

ABSTRACT:

Background

Despite similar performance metrics, women medical trainees routinely self-assess their own skills lower than men. The phenomenon of a "confidence gap" between genders, where women report lower self-confidence independent of actual ability or competency, may have an important interaction with gender differences in assessment. Identifying whether there are gender-based differences in how confidence is mentioned in written evaluations is a necessary step to understand the interaction between evaluation and the gender-based confidence gap.

Objective

To analyze faculty evaluations of internal medicine (IM) residents for gender-based patterns in the use of iterations of "confidence."

Design

We performed a retrospective cohort study of all inpatient faculty evaluations of University of Pennsylvania IM residents from 2018 to 2021. We performed n-gram text-mining to identify evaluations containing the terms "confident," "confidence," or "confidently." We performed univariable and multivariable logistic regression to determine the association between resident gender and references to confidence (including comments reflecting too little confidence), adjusting for faculty gender, post-graduate year (PGY), numeric rating, and service.

Subjects

University of Pennsylvania IM residents from 2018 to 2021.

Key results

There were 5416 evaluations of IM residents (165 women [51%], 156 men [49%]) submitted by 356 faculty members (149 women [51%]), of which 7.1 % (n=356) contained references to confidence. There was a significant positive association between the mention of confidence and women resident gender (OR 1.54, CI 1.23-1.92; p<0.001), which persisted after adjustment for faculty gender, numeric rating, and PGY level. Eighty evaluations of the cohort explicitly mentioned the resident having "too little confidence," which was also associated with women resident gender (OR 1.66, CI 1.05-2.62; p=0.031).

Conclusion

Narrative evaluations of women residents were more likely to contain references to confidence, after adjustment for numerical score, PGY level, and faculty gender, which may perpetuate the gender-based confidence gap, introduce bias, and ultimately impact professional identity development.

SUBMITTER: Heath JK

PROVIDER: S-EPMC9296754 | biostudies-literature | 2022 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The Context of "Confidence": Analyzing the Term Confidence in Resident Evaluations.

Heath Janae K JK Alvarado Meagan E ME Clancy Caitlin B CB Barton Todd D TD Kogan Jennifer R JR Dine C Jessica CJ

Journal of general internal medicine 20220616 9

<h4>Background</h4>Despite similar performance metrics, women medical trainees routinely self-assess their own skills lower than men. The phenomenon of a "confidence gap" between genders, where women report lower self-confidence independent of actual ability or competency, may have an important interaction with gender differences in assessment. Identifying whether there are gender-based differences in how confidence is mentioned in written evaluations is a necessary step to understand the intera ...[more]

PMID: 35710674

Similar Datasets

Project description:PurposeThis study analyzes assessments within radiation oncology (RO) to determine characteristics of existing assessment methods and then report resident perceptions of these methods. We hypothesize familiarity with evaluation methods is predictive of the perceived utility of evaluations and behavioral changes.Methods and materialsThis study was conducted in 2 phases. Phase 1 involved requesting resident evaluation forms from RO residency programs to assess the Accreditation Council for Graduate Medical Education 6 Core Competencies. Analysis of variance was used to determine any significant differences between institutions or categories of questions. In phase 2, RO residents were surveyed about familiarity with the Accreditation Council for Graduate Medical Education Milestones and their perceptions about the current methods. Responses to questions were further analyzed using linear regression models.ResultsIn phase 1, forms were obtained from 13 institutions, and they were based on the 6 Core Competencies with an average of 19 questions (standard deviation, 11; range, 5-47) in total. Analysis of variance did not show significant variation in the number of questions between the categories (F = 0.78, P = .6). A significant difference in the mean number of questions used for assessing each of the competencies was found between institutions (F = 6.6, P < .01). In phase 2, a majority of surveyed residents reported being "not" or only "slightly familiar" with the competencies (59.6%) and the factors used to assess them (73.1%). Resident-reported familiarity with the evaluation methods was not found to be a significant predictor of likelihood of changing postevaluation (coefficient = 0.41, P = .204), intimidation from receiving evaluations (coefficient = -0.06, P = .792), stress of receiving evaluations (coefficient = -0.11, P = .62), or usefulness of evaluations (coefficient = -0.02, P = .83).ConclusionsFamiliarity with evaluation methods is not correlated with perceptions or behavioral changes necessitating further investigation of alternative predictor variables. Despite the low familiarity with evaluation tools, most residents reported that evaluations were useful and likely to elicit changes in their behaviors and practice, highlighting the value of current evaluation methods.

Dataset Information

The Context of "Confidence": Analyzing the Term Confidence in Resident Evaluations.

Background

Objective

Design

Subjects

Key results

Conclusion

Publications

The Context of "Confidence": Analyzing the Term Confidence in Resident Evaluations.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets