Assessing GPT-4's Performance in Delivering Medical Advice: Comparative Analysis With Human Experts.

ABSTRACT:

Background

Accurate medical advice is paramount in ensuring optimal patient care, and misinformation can lead to misguided decisions with potentially detrimental health outcomes. The emergence of large language models (LLMs) such as OpenAI's GPT-4 has spurred interest in their potential health care applications, particularly in automated medical consultation. Yet, rigorous investigations comparing their performance to human experts remain sparse.

Objective

This study aims to compare the medical accuracy of GPT-4 with human experts in providing medical advice using real-world user-generated queries, with a specific focus on cardiology. It also sought to analyze the performance of GPT-4 and human experts in specific question categories, including drug or medication information

SUBMITTER: Jo E 

PROVIDER: S-EPMC11250047 | biostudies-literature | 2024 Jul

REPOSITORIES: biostudies-literature