Can OpenAI's New o1 Model Outperform Its Predecessors in Common Eye Care Queries?

ABSTRACT:

Objective

The newly launched OpenAI o1 is said to offer improved reasoning, potentially providing higher quality responses to eye care queries. However, its performance remains unassessed. We evaluated the performance of o1, ChatGPT-4o, and ChatGPT-4 in addressing ophthalmic-related queries, focusing on correctness, completeness, and readability.

Design

Cross-sectional study.

Subjects

Sixteen queries, previously identified as suboptimally responded to by ChatGPT-4 from prior studies, were used, covering 3 subtopics: myopia (6 questions), ocular symptoms (4 questions), and retinal conditions (6 questions).

Methods

For each subtopic, 3 attending-level ophthalmologists, masked to the model sources, evaluated the responses based on correctness, completeness, and re

SUBMITTER: Pushpanathan K 

PROVIDER: S-EPMC12022690 | biostudies-literature | 2025 Jul-Aug

REPOSITORIES: biostudies-literature