High accuracy but limited readability of large language model-generated responses to frequently asked questions about Kienbock's disease.

ABSTRACT:

Background

This study aimed to assess the quality and readability of large language model-generated responses to frequently asked questions (FAQs) about Kienböck's disease (KD).

Methods

Nineteen FAQs about KD were selected, and the questions were divided into three categories: general knowledge, diagnosis, and treatment. The questions were inputted into the Chat Generative Pre-trained Transformer 4 (ChatGPT4) webpage using the zero-shot prompting method, and the responses were recorded. Hand surgeons with at least 5 years of experience and advanced English proficiency were individually contacted over instant WhatsApp messaging and requested to assess the responses. The quality of each response was analyzed by 33 experienced hand surgeons using the Global Quality Scale (GQS).

SUBMITTER: Asfuroglu ZM 

PROVIDER: S-EPMC11536837 | biostudies-literature | 2024 Nov

REPOSITORIES: biostudies-literature