Evaluating factors that impact scoring an open response situational judgment test: a mixed methods approach.

ABSTRACT:

Introduction

Situational judgment tests (SJT) are commonly used in admissions to measure skills associated with professionalism. Although open-response SJTs have shown strong psychometric properties, assessors' personal beliefs, experiences, and cultural backgrounds may influence how they perceive, organize and evaluate information within test takers' diverse responses. Additionally, SJT research typically focuses on reliability and predictive validity, whereas the construct validity of open response SJTs remains underexplored. This mixed methods study aims to address this gap by exploring the construct-(ir)relevant factors that may impact assessors' evaluation of professionalism in open response SJTs.

Methods

For this study, we used data from Casper, an open response SJT co

SUBMITTER: Iqbal MZ 

PROVIDER: S-EPMC11743161 | biostudies-literature | 2024

REPOSITORIES: biostudies-literature