Natural language processing for automatic evaluation of free-text answers - a feasibility study based on the European Diploma in Radiology examination.

ABSTRACT:

Background

Written medical examinations consist of multiple-choice questions and/or free-text answers. The latter require manual evaluation and rating, which is time-consuming and potentially error-prone. We tested whether natural language processing (NLP) can be used to automatically analyze free-text answers to support the review process.

Methods

The European Board of Radiology of the European Society of Radiology provided representative datasets comprising sample questions, answer keys, participant answers, and reviewer markings from European Diploma in Radiology examinations. Three free-text questions with the highest number of corresponding answers were selected: Questions 1 and 2 were "unstructured" and required a typical free-text answer whereas question 3 was "struct

SUBMITTER: Stoehr F 

PROVIDER: S-EPMC10509084 | biostudies-literature | 2023 Sep

REPOSITORIES: biostudies-literature