Evaluating the Current Ability of ChatGPT to Assist in Professional Otolaryngology Education.

ABSTRACT:

Objective

To quantify ChatGPT's concordance with expert Otolaryngologists when posed with high-level questions that require blending rote memorization and critical thinking.

Study design

Cross-sectional survey.

Setting

OpenAI's ChatGPT-3.5 Platform.

Methods

Two board-certified otolaryngologists (HZ, RS) input 2 sets of 30 text-based questions (open-ended and single-answer multiple-choice) into the ChatGPT-3.5 model. Responses were rated on a scale (correct, partially correct, incorrect) by each Otolaryngologist working simultaneously with the AI model. Interrater agreement percentage was based on binomial distribution for calculating the 95% confidence intervals and performing significance tests. Statistical significance was defined as P < .05 for 2-side

SUBMITTER: Zalzal HG 

PROVIDER: S-EPMC10663981 | biostudies-literature | 2023 Oct-Dec

REPOSITORIES: biostudies-literature