Effectiveness of a large language model for clinical information retrieval regarding shoulder arthroplasty.

ABSTRACT:

Purpose

To determine the scope and accuracy of medical information provided by ChatGPT-4 in response to clinical queries concerning total shoulder arthroplasty (TSA), and to compare these results to those of the Google search engine.

Methods

A patient-replicated query for 'total shoulder replacement' was performed using both Google Web Search (the most frequently used search engine worldwide) and ChatGPT-4. The top 10 frequently asked questions (FAQs), answers, and associated sources were extracted. This search was performed again independently to identify the top 10 FAQs necessitating numerical responses such that the concordance of answers could be compared between Google and ChatGPT-4. The clinical relevance and accuracy of the provided information were graded by two blin

SUBMITTER: Oeding JF 

PROVIDER: S-EPMC11649951 | biostudies-literature | 2024 Oct

REPOSITORIES: biostudies-literature