Development of Immediate Self-Feedback Very Short Answer Questions: Implementing Testlet Response Theory in Formative Examinations Across Multiple Occasions.

ABSTRACT:

Background

The novel Immediate Self-feedback Very Short Answer Question (ISF-VSAQ) format exhibited testlet effect due to its instant feedback feature. This study utilized the testlet-as-a-polytomous-item-modeling (TPIM), an extension of item response theory, to tackle the testlet-related challenges.

Methods

Ninety-four pre-clinical students participated in two ten-item ISF-VSAQ exams on cardiovascular drugs based on a parallel blueprint. Each question involves clinical vignettes followed by expected answers, self-marking, and understanding levels. Messick's validity framework guided the collection of validity evidence.

Results

Validity evidence included five sources: (1) Content: Experts reviews and alignment with the standard examination blueprint. (2) Response proc

SUBMITTER: Lertsakulbunlue S 

PROVIDER: S-EPMC11933642 | biostudies-literature | 2025 Feb

REPOSITORIES: biostudies-literature