Evaluation of a Large Language Model's Ability to Assist in an Orthopedic Hand Clinic.

ABSTRACT:

Background

Advancements in artificial intelligence technology, such as OpenAI's large language model, ChatGPT, could transform medicine through applications in a clinical setting. This study aimed to assess the utility of ChatGPT as a clinical assistant in an orthopedic hand clinic.

Methods

Nine clinical vignettes, describing various common and uncommon hand pathologies, were constructed and reviewed by 4 fellowship-trained orthopedic hand surgeons and an orthopedic resident. ChatGPT was given these vignettes and asked to generate a differential diagnosis, potential workup plan, and provide treatment options for its top differential. Responses were graded for accuracy and the overall utility scored on a 5-point Likert scale.

Results

The diagnostic accuracy of ChatGPT

SUBMITTER: Kotzur T 

PROVIDER: S-EPMC11571334 | biostudies-literature | 2024 Jun

REPOSITORIES: biostudies-literature