A comparative evaluation of ChatGPT 3.5 and ChatGPT 4 in responses to selected genetics questions.

ABSTRACT:

Objectives

To evaluate the efficacy of ChatGPT 4 (GPT-4) in delivering genetic information about BRCA1, HFE, and MLH1, building on previous findings with ChatGPT 3.5 (GPT-3.5). To focus on assessing the utility, limitations, and ethical implications of using ChatGPT in medical settings.

Materials and methods

A structured survey was developed to assess GPT-4's clinical value. An expert panel of genetic counselors and clinical geneticists evaluated GPT-4's responses to these questions. We also performed comparative analysis with GPT-3.5, utilizing descriptive statistics and using Prism 9 for data analysis.

Results

The findings indicate improved accuracy in GPT-4 over GPT-3.5 (P < .0001). However, notable errors in accuracy remained. The relevance of responses varied in

SUBMITTER: McGrath SP 

PROVIDER: S-EPMC11413464 | biostudies-literature | 2024 Oct

REPOSITORIES: biostudies-literature