Performance of ChatGPT on Chinese Master's Degree Entrance Examination in Clinical Medicine.

ABSTRACT:

Background

ChatGPT is a large language model designed to generate responses based on a contextual understanding of user queries and requests. This study utilised the entrance examination for the Master of Clinical Medicine in Traditional Chinese Medicine to assesses the reliability and practicality of ChatGPT within the domain of medical education.

Methods

We selected 330 single and multiple-choice questions from the 2021 and 2022 Chinese Master of Clinical Medicine comprehensive examinations, which did not include any images or tables. To ensure the test's accuracy and authenticity, we preserved the original format of the query and alternative test texts, without any modifications or explanations.

Results

Both ChatGPT3.5 and GPT-4 attained average scores surpassing t

SUBMITTER: Li KC 

PROVIDER: S-EPMC10994287 | biostudies-literature | 2024

REPOSITORIES: biostudies-literature