Physician vs. AI-generated messages in urology: evaluation of accuracy, completeness, and preference by patients and physicians.

ABSTRACT:

Purpose

To evaluate the accuracy, comprehensiveness, empathetic tone, and patient preference for AI and urologist responses to patient messages concerning common BPH questions across phases of care.

Methods

Cross-sectional study evaluating responses to 20 BPH-related questions generated by 2 AI chatbots and 4 urologists in a simulated clinical messaging environment without direct patient interaction. Accuracy, completeness, and empathetic tone of responses assessed by experts using Likert scales, and preferences and perceptions of authorship (chatbot vs. human) rated by non-medical evaluators.

Results

Five non-medical volunteers independently evaluated, ranked, and inferred the source for 120 responses (n = 600 total). For volunteer evaluations, the mean (SD) score of

SUBMITTER: Robinson EJ 

PROVIDER: S-EPMC11680670 | biostudies-literature | 2024 Dec

REPOSITORIES: biostudies-literature