Probing artificial intelligence in neurosurgical training: ChatGPT takes a neurosurgical residents written exam.

ABSTRACT:

Introduction

Artificial Intelligence tools are being introduced in almost every field of human life, including medical sciences and medical education, among scepticism and enthusiasm.

Research question

to assess how a generative language tool (Generative Pretrained Transformer 3.5, ChatGPT) performs at both generating questions and answering a neurosurgical residents' written exam. Namely, to assess how ChatGPT generates questions, how it answers human-generated questions, how residents answer AI-generated questions and how AI answers its self-generated question.

Materials and methods

50 questions were included in the written exam, 46 questions were generated by humans (senior staff members) and 4 were generated by ChatGPT. 11 participants took the exam (ChatGPT and 1

SUBMITTER: Bartoli A 

PROVIDER: S-EPMC10753430 | biostudies-literature | 2024

REPOSITORIES: biostudies-literature