Unknown

Dataset Information

The use of artificial intelligence based chat bots in ophthalmology triage.


ABSTRACT:

Purpose

To evaluate AI-based chat bots ability to accurately answer common patient's questions in the field of ophthalmology.

Methods

An experienced ophthalmologist curated a set of 20 representative questions and responses were sought from two AI generative models: OpenAI's ChatGPT and Google's Bard (Gemini Pro). Eight expert ophthalmologists from different sub-specialties assessed each response, blinded to the source, and ranked them by three metrics-accuracy, comprehensiveness, and clarity, on a 1-5 scale.

Results

For accuracy, ChatGPT scored a median of 4.0, whereas Bard scored a median of 3.0. In terms of comprehensiveness, ChatGPT achieved a median score of 4.5, compared to Bard which scored a median of 3.0. Regarding clarity, ChatGPT maintained a higher score w

SUBMITTER: David D 

PROVIDER: S-EPMC11885819 | biostudies-literature | 2025 Mar

REPOSITORIES: biostudies-literature