Machine Scoring of Medical Students' Written Clinical Reasoning: Initial Validity Evidence.

ABSTRACT:

Purpose

Developing medical students' clinical reasoning requires a structured longitudinal curriculum with frequent targeted assessment and feedback. Performance-based assessments, which have the strongest validity evidence, are currently not feasible for this purpose because they are time-intensive to score. This study explored the potential of using machine learning technologies to score one such assessment-the diagnostic justification essay.

Method

From May to September 2018, machine scoring algorithms were trained to score a sample of 700 diagnostic justification essays written by 414 third-year medical students from the Southern Illinois University School of Medicine classes of 2012-2017. The algorithms applied semantically based natural language processing metrics (e.g

SUBMITTER: Cianciolo AT 

PROVIDER: S-EPMC8243833 | biostudies-literature | 2021 Jul

REPOSITORIES: biostudies-literature