ChatGPT and reference intervals: a comparative analysis of repeatability in GPT-3.5 Turbo, GPT-4, and GPT-4o.

ABSTRACT:

Background

Large language models such as ChatGPT hold promise as rapid "curbside consultation" tools in laboratory medicine. However, their ability to generate consistent and clinically reliable reference intervals-particularly in the absence of contextual clinical information-remains uncertain.

Method

This cross-sectional study evaluated whether three versions of ChatGPT (GPT-3.5-Turbo, GPT-4, GPT-4o) maintain repeatable reference-interval outputs when the prompt intentionally omits the interval, using reference interval variability as a stress-test for model consistency. Standardized prompts were submitted through 726,000 chatbot requests. A total of 246,842 reference intervals across 47 laboratory parameters were then analyzed for consistency using the coefficient of vari

SUBMITTER: Meyer A 

PROVIDER: S-EPMC12740928 | biostudies-literature | 2025

REPOSITORIES: biostudies-literature