Can AI match emergency physicians in managing common emergency cases? A comparative performance evaluation.

ABSTRACT:

Background

Large language models (LLMs) such as ChatGPT are increasingly explored for clinical decision support. However, their performance in high-stakes emergency scenarios remains underexamined. This study aimed to evaluate ChatGPT's diagnostic and therapeutic accuracy compared to a board-certified emergency physician across diverse emergency cases.

Methods

This comparative study was conducted using 15 standardized emergency scenarios sourced from validated academic platforms (Geeky Medics, Life in the Fast Lane, Emergency Medicine Cases). ChatGPT (GPT-4) and a physician independently evaluated each case based on five predefined parameters: diagnosis, investigations, initial treatment, clinical safety, and decision-making complexity. Cases were scored out of 5. Concordanc

SUBMITTER: Gun M 

PROVIDER: S-EPMC12315197 | biostudies-literature | 2025 Jul

REPOSITORIES: biostudies-literature