Can ChatGPT generate surgical multiple-choice questions comparable to those written by a surgeon?

ABSTRACT:

Background

This study aimed to determine whether surgical multiple-choice questions generated by ChatGPT are comparable to those written by human experts (surgeons).

Methods

The study was conducted at a medical school and involved 112 fourth-year medical students. Based on five learning objectives in general surgery (colorectal, gastric, trauma, breast, thyroid), ChatGPT and surgeons generated five multiple-choice questions. No change was made to the ChatGPT-generated questions. The statistical properties of these questions, including correlations between two group of questions and correlations with total scores (item discrimination) in a general surgery clerkship exam, were reported.

Results

There was a significant positive correlation between the ChatGPT-generated a

SUBMITTER: Kıyak YS 

PROVIDER: S-EPMC11657069 | biostudies-literature | 2025

REPOSITORIES: biostudies-literature