Designing successful virtual residency interviews: a survey-based needs assessment of applicants across medical specialties
Ontology highlight
ABSTRACT: Background
Residency selection in the United States relied on in-person interviews for many decades. The COVID-19 pandemic and recommendations from the Coalition for Physician Accountability (COPA) required programs to implement virtual interviews for the 2020–2021 residency selection cycle. Although virtual interviews may become the norm in the future, there is scant data at the institutional level to inform how to best approach this process. Objective
To describe the perceptions of applicants to several residency programs at one institution on the importance of virtual recruitment features and assess the impact on their overall ranking decisions. Methods
Applicants who interviewed for 12 medical and surgical residency programs during the 2020–2021 cycle at the University of California San Francisco were invited to participate in an anonymous survey in March 2021, after all interviews were completed. A survey consisting of 26 questions was administered to applicants on features that are important during interviews and the impact on their ranking decisions scored on a 5-point Likert scale. Results
Of the 1422 participating applicants, 303 (21%) completed the survey. The most important feature for applicants during the interview day was getting a feel of the program (92%). Conversations with residents (91%) and faculty (79%) were also highly rated. Respondents reported morale and happiness of residents (71%) as an extremely important factor in their overall ranking decision . Conclusion
Programs should consider prioritizing features that aid in alignment with getting to know residents and faculty and provide a sense of morale over emphasis on the institutional and location features. Supplementary Information
The online version contains supplementary material available at 10.1007/s44186-022-00004-5.
SUBMITTER: Sequeira N
PROVIDER: S-EPMC8906359 | biostudies-literature | 2022 Jan
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundAll Canadian Residency Matching Service (CaRMS) R1 interviews were conducted virtually for the first time in 2021. We explored the facilitators, barriers, and implications of the virtual interview process for the CaRMS R1 match and provide recommendations for improvement.MethodsWe conducted a cross-sectional survey study of CaRMS R1 residency applicants and interviewers across Canada in 2021. Surveys were distributed by email to the interviewers, and by email, social media, or newsletter to the applicants. Inductive thematic analysis was used for open-ended items. Recommendations were provided as frequencies to demonstrate strength. Close-ended items were described and compared across groups using Chi-Square Fisher's Exact tests.ResultsA total of 127 applicants and 400 interviewers, including 127 program directors, responded to the survey. 193/380 (50.8%) interviewers and 90/118 (76.3%) applicants preferred virtual over in-person interview formats. Facilitators of the virtual interview format included cost and time savings, ease of scheduling, reduced environmental impact, greater equity, less stress, greater reach and participation, and safety. Barriers of the virtual interview format included reduced informal conversations, limited ability for applicants to explore programs at different locations, limited ability for programs to assess applicants' interest, technological issues, concern for interview integrity, limited non-verbal communication, and reduced networking. The most helpful media for applicants to learn about residency programs were program websites, the CaRMS/AFMC websites, and recruitment videos. Additionally, panel interviews were preferred by applicants for their ability to showcase themselves and build connections with multiple interviewers. Respondents provided recommendations regarding: (1) dissemination of program information, (2) the use of technology, and (3) the virtual interview format.ConclusionsPerceptions of 2021 CaRMS R1 virtual interviews were favourable among applicants and interviewers. Recommendations from this study can help improve future iterations of virtual interviews.
| S-EPMC10226872 | biostudies-literature
Project description:Background Virtual interviews for surgery residency may improve interview opportunities for applicants from underrepresented in medicine (UIM) and lower socioeconomic backgrounds. Objective To compare the geographic reach of surgical residency applicants during in-person versus virtual interviews. Methods This study compared applicants for the 2019 (in-person) and 2020 (virtual interviews) application cycle for surgery residency. Geographic reach (GR) was defined as the distance between applicants' current location and the program. Federal Financial Institutions Examination Council's website supplied socioeconomic data using applicants' geographic locations. Applicant demographics, United States Medical Licensing Examination (USMLE) scores, and geographic distance to program were collected. Multivariable analyses examined GR with interaction terms between interview type, UIM status, and socioeconomic status, while controlling for USMLE scores. Results A total of 667 (2019) and 698 (2020) National Resident Matching Program applications were reviewed. Overall, there was no difference in GR for applicants during in-person and virtual interviews in multivariable testing. UIM status had no association with GR for in-person interviews, but virtual interviews were associated with an increased GR for UIM applicants compared to non-UIM applicants (235.17; 95% CI 28.87-441.47; P=.02). For in-person interviews, applicants living in communities with poverty levels ≥7% had less GR vs those in communities with levels <7% (-332.45; 95% CI -492.10, -172.79; P<.001), an effect not observed during virtual interviews. Conclusions There was no difference in overall GR, or the proportion of UIM applicants or those from higher poverty level communities, but virtual survey interviews during the COVID-19 pandemic were associated with increased GR for UIM and from lower socioeconomic backgrounds applicants.
| S-EPMC10686643 | biostudies-literature
Project description:The 2020-2021 otolaryngology residency application cycle has been immensely distorted by travel restrictions mandated in response to coronavirus disease 2019, limiting opportunities for applicants to meet and rotate with programs of interest. The purpose of this study was to evaluate otolaryngology applicants' preferences toward the content and format of virtual residency information sessions. An anonymous online survey was developed to gauge applicants' virtual exposure to otolaryngology programs and investigate their preferences during virtual sessions. Almost all respondents attended at least 1 virtual information session (89%). Respondents felt that the most important aspects of these sessions were meeting residents, learning about operative volume, and meeting faculty. The majority (85%) preferred these sessions last no longer than 2 hours. Participants preferred virtual sessions to include breakout sessions with participant video/microphone on. These findings have implications for future virtual resident recruitment strategies.
| S-EPMC8013640 | biostudies-literature
Project description:BackgroundTravel costs and application fees make in-person residency interviews expensive, compounding existing financial burdens on medical students. We hypothesized virtual interviews (VI) would be associated with decreased costs for applicants compared to in-person interviews (IPI) but at the expense of gathering information with which to assess the program.ObjectiveTo survey senior medical students and postgraduate year (PGY)-1 residents regarding their financial burden and program perception during virtual versus in-person interviews.MethodsThe authors conducted a single center, multispecialty study comparing costs of IPI vs VI from 2020-2021. Fourth-year medical students and PGY-1 residents completed one-time surveys regarding interview costs and program perception. The authors compared responses between IPI and VI groups. Potential debt accrual was calculated for 3- and 7-year residencies.ResultsTwo hundred fifty-two (of 884, 29%) surveys were completed comprising 75 of 169 (44%) IPI and 177 of 715 (25%) VI respondents. The VI group had significantly lower interview costs compared to the IPI group (median $1,000 [$469-$2,050 IQR] $784-$1,216 99% CI vs $3,200 [$1,700-$5,500 IQR] $2,404-$3,996 99% CI, P<.001). The VI group scored lower for feeling the interview process was an accurate representation of the residency program (3.3 [0.5] vs 4.1 [0.7], P<.001). Assuming interview costs were completely loan-funded, the IPI group will have accumulated potential total loan amounts $2,334 higher than the VI group at 2% interest and $2,620 at 6% interest. These differences were magnified for a 7-year residency.ConclusionsVirtual interviews save applicants thousands of dollars at the expense of their perception of the residency program.
| S-EPMC9765904 | biostudies-literature
Project description:ObjectiveTo investigate the perception and value of virtual open houses for urology applicants in the COVID-19 era, since students can no longer attend subinternships and all interviews will be conducted virtually.MethodsA Twitter survey was sent to 230 likely urology applicants connected through the UroResidency platform. It asked about the relative value of components of the virtual open house and areas for suggested improvement.ResultsSeventy responded. Most potential applicants valued virtual open houses that discussed strengths and weaknesses of the program, had time to interact directly with the faculty, and included resident led presentations or discussions. Most agreed programs needed to have more direct time with residents to better understand the culture of the program.ConclusionIn this first virtual interview season for urology, likely applicants generally engage in virtual open houses and strongly prefer time to interact directly with residents to assess the program culture.
| S-EPMC7547824 | biostudies-literature
Project description:IntroductionDue to the COVID-19 pandemic, the recruitment cycle for the 2021 Match was performed virtually. This Association for Surgical Education (ASE)-sponsored survey set out to study applicants' ability to assess the factors contributing to fit through video interviews.MethodsAn IRB-approved, online, anonymous survey was distributed to surgical applicants at a single academic institution and through the ASE clerkship director distribution list between the rank order list certification deadline and Match Day. Applicants used 5-point Likert-type scales to rate factors for importance to fit and their ease of assessment through video interviewing. A variety of recruitment activities were also rated by applicants for their perceived helpfulness in assessment of fit.ResultsOne hundred and eighty-three applicants responded to the survey. The three most important factors for applicant fit were how much the program cared, how satisfied residents seem with their program, and how well residents get along. Resident rapport, diversity of the patient population, and quality of the facilities were hardest to assess through video interviews. In general, diversity-related factors were more important to female and non-White applicants, but not more difficult to assess. Interview day and resident-only virtual panels were the most helpful recruitment activities, while virtual campus tours, faculty-only panels, and a program's social media were the least helpful.ConclusionsThis study provides valuable insight into the limitations of virtual recruitment for surgical applicants' perception of fit. These findings and the recommendations herein should be taken into consideration by residency program leadership to ensure successful recruitment of diverse residency classes.
| S-EPMC10019094 | biostudies-literature
Project description:Background and aimsAdvanced endoscopy (AE) fellowship interviews during the 2020 application cycle were held virtually due to COVID-19 pandemic. This study aimed to characterize the application experience with virtual interviews.MethodsApplicants and programs participating in the 2020 AE fellowship match were prospectively sent separate 17-question surveys. Responses were collected using Research Electronic Data Capture.ResultsIn total, 63/104 applicants (60.6%) matched and 64/71 (90.1%) positions filled within the match. The survey was completed by 37/87 (42.5%) applicants and 71 interviewers from 43/65 (66.2%) participating programs. Most applicants (64.7%) preferred a 1:1 applicant:faculty ratio and a 20-minute interview (73.5%), which was used by programs 50.7% and 47.8%, respectively. The majority of applicants (82.4%) and interviewers (76.8%) reported overall satisfaction with virtual interviews. The biggest limitations for applicants were getting a "feel" for the program and endoscopy unit. In the future, 41.2% of applicants preferred only virtual interviews compared to 7.2% of interviewers (P< 0.01). Conversely, 14.7% of applicants preferred only in-person interviews compared to 39.1% of interviewers (P= 0.01). Half of the interviewers (50.7%) would negatively view applicants who chose a virtual option over an in-person interview if both were offered.ConclusionThe majority of AE fellowship applicants and programs reported overall satisfaction with virtual interviews during the COVID-19 pandemic. Given the potential benefits, virtual interviews may have an increasing role in future residency and fellowship applications. Programs that conduct virtual interviews need to be aware of its limitations and have measures to improve the applicant experience and mitigate potential biases of interviewers.
| S-EPMC8528488 | biostudies-literature
Project description:BackgroundEmergency medicine (EM) applicants are encouraged to consider their own "competitiveness" when deciding on the number of applications to submit. Program directors rank the Standardized Letter of Evaluation (SLOE) as the most important factor when reviewing an applicant. Accurate insight into how clinical performance is reflected on the SLOE could improve medical students' ability to gauge their own competitiveness.ObjectiveThis study aims to determine the accuracy of students' self-assessment by SLOE evaluation measures when compared to the SLOE completed by faculty after their EM clerkship.MethodsParticipants of this multicenter study included fourth-year medical students who had completed their EM clerkship and were applying to EM residency. Students completed a modified SLOE to reflect rankings they believed they would receive on their official SLOE. Additionally, students completed a survey assessing their knowledge of the SLOE, their perception of feedback during the clerkship, and their self-perceived competitiveness as an EM applicant. Correlation between the rankings on the student-completed SLOE and the official SLOE was analyzed using the Kendall correlation.ResultsOf the 49 eligible students, 42 (85.7%) completed the study. The correlation between scores on the student-completed and official SLOE were significantly low (r < 0.68) for each item. The majority of students agreed that they were satisfied by the quantity and quality of feedback they received (31/42, 73.8%). Few students agreed that they knew how many applications to submit to ensure a match in EM (7/42, 16.7%).ConclusionThis study demonstrates that students did not accurately predict their rankings on the official SLOE at the end of an EM rotation and had little insight into their competitiveness as an applicant. These findings highlight opportunities to mitigate the burden on students and programs caused by the increasing number of applications per applicant. Further research is needed as to whether strategies to increase insight into competitiveness are effective.
| S-EPMC8171773 | biostudies-literature
Project description:BackgroundThe COVID-19 pandemic altered how residency interviews occur. Despite 2 years of web-based interviews, these are still perceived as inferior to in-person experiences. Showcasing a program and location is critical for recruitment; however, it is difficult to highlight the program's location and community digitally. This article presents the authors' viewpoints on designing and implementing a virtual second look for residency applicants.ObjectiveOur objective was to host a web-based event to feature the benefits of living in Winston-Salem, North Carolina, for residency applicants, enhance recruitment efforts, and ensure a successful residency match. The goal was to cover topics that interested all applicants, highlight how Winston-Salem is a special place to live, involve current residents, and engage community members.MethodsThree programs-child neurology, neurology, and family medicine were chosen for a pilot virtual second look. All residency program directors' were asked to recommend community contacts and help identify residents and faculty who may serve as content experts on one of the topics in the panel discussions. A total of 24 community leaders from restaurants, venues, schools, and businesses were contacted, and 18 agreed to participate. The panel discussions included living in and raising a family in Winston-Salem, experiencing Winston-Salem arts and music, where to eat and drink like a local, and enjoying sports and outdoors in the area. The 2-hour event was hosted on Zoom. Postevent feedback assessments were automatically sent to each registrant through Research Electronic Data Capture (REDCap). This study was deemed exempt from Wake Forest University Health Sciences institutional review board review (IRB00088703).ResultsThere were 51 registrants for the event, and 28 of 48 registrants provided postevent feedback, which was positive. The authors found in the MATCH residency results that 2 of 2 child neurology positions, 4 of 6 adult neurology positions, and 1 of 10 family medicine positions attended our second look event. One adult neurology resident who did not participate was an internal candidate. All respondents agreed or strongly agreed that the session was valuable, well organized, and met their expectations or goals. Furthermore, all respondents gained new information during this web-based event not obtained during their interview day.ConclusionsThe virtual second look event for residency attendees featured the benefits of living in Winston-Salem, and the perspectives of current residents. Feedback from the session was overall positive; however, a top desire would be devoting more time for the applicants to ask questions directly to the community leaders and our resident trainees. This program could be reproducible by other institutions. It could be broadened to a graduate medical education-wide virtual second look event where all medical and surgical programs could opt to participate, facilitating an equitable opportunity for prospective applicants.
| S-EPMC10520764 | biostudies-literature
Project description:ImportanceDisparities in representation between sexes have been shown at multiple career stages in medicine despite increasing representation in the overall physician workforce.ObjectiveTo assess sex representation of applicants to the Canadian R-1 entry match for postgraduate training programs from 1995 to 2019, comparing distribution between different specialties as well as applied vs matched applicants.Design, setting, and participantsThis cross-sectional analysis of aggregate data provided by the Canadian Resident Matching Service between 1995 and 2019 analyzed aggregate data for the Canadian R-1 residency match from 1995 through 2019.ExposuresApplicant sex as reported in the Canadian Resident Matching Service database.Main outcomes and measuresThe sex representation of applicants was compared and the longitudinal trends in sex representation were analyzed by specialty between 1995 and 2019. The sex representation of overall applicants to the Canadian R-1 entry match were compared with matched applicants, and both were stratified by specialty.ResultsA total of 48 424 applicants were identified (26 407 [54.5%] female applicants), of which 41 037 were matched applicants. Using specialty groupings, female applicants were most highly represented in obstetrics and gynecology (1776 of 2090 [85.0%]) and least represented in radiology (658 of 2055 [32.0%]). Within individual subspecialties, female applicants had the lowest representation in neurosurgery (90 of 394 [22.8%]). While female applicants represented an increasing proportion of the overall applicant population between 1995 and 2019 (z = 2.71; P = .007), significant increases were seen in some, but not all, individual specialties. Differences by sex were found among Canadian medical graduate match rates to their top-ranked specialty: female applicants had a lower likelihood of being rejected for family medicine (rejection of male applicants: OR, 0.46; 95% CI, 0.39-0.54; P < .001) and psychiatry (OR, 0.59; 95% CI, 0.46-0.76; P < .001) and were more likely to be rejected for all-encompassing surgery (acceptance of male applicants: OR, 1.19; 95% CI, 1.10-1.28; P < .001).Conclusions and relevanceIncreasing representation of female residency applicants over time was seen in some, but not all, medical specialties in Canada, and sex-based differences in successful match rates were observed in some specialties. The reasons for these disparities require further investigation for corrective strategies to be identified.
| S-EPMC7686870 | biostudies-literature