Assessing the Accuracy of Responses by the Language Model ChatGPT to Questions Regarding Bariatric Surgery.

ABSTRACT:

Purpose

ChatGPT is a large language model trained on a large dataset covering a broad range of topics, including the medical literature. We aim to examine its accuracy and reproducibility in answering patient questions regarding bariatric surgery.

Materials and methods

Questions were gathered from nationally regarded professional societies and health institutions as well as Facebook support groups. Board-certified bariatric surgeons graded the accuracy and reproducibility of responses. The grading scale included the following: (1) comprehensive, (2) correct but inadequate, (3) some correct and some incorrect, and (4) completely incorrect. Reproducibility was determined by asking the model each question twice and examining difference in grading category between the two respon

SUBMITTER: Samaan JS 

PROVIDER: S-EPMC10234918 | biostudies-literature | 2023 Jun

REPOSITORIES: biostudies-literature