Developing a video-based method to compare and adjust examiner effects in fully nested OSCEs.

ABSTRACT:

Background

Although averaging across multiple examiners' judgements reduces unwanted overall score variability in objective structured clinical examinations (OSCE), designs involving several parallel circuits of the OSCE require that different examiner cohorts collectively judge performances to the same standard in order to avoid bias. Prior research suggests the potential for important examiner-cohort effects in distributed or national examinations that could compromise fairness or patient safety, but despite their importance, these effects are rarely investigated because fully nested assessment designs make them very difficult to study. We describe initial use of a new method to measure and adjust for examiner-cohort effects on students' scores.

Methods

We developed video-

SUBMITTER: Yeates P 

PROVIDER: S-EPMC6519246 | biostudies-literature | 2019 Mar

REPOSITORIES: biostudies-literature