Consistent Performance of GPT-4o in Rare Disease Diagnosis Across Nine Languages and 4967 Cases.

ABSTRACT:

Background

Large language models (LLMs) are increasingly used in the medical field for diverse applications including differential diagnostic support. The estimated training data used to create LLMs such as the Generative Pretrained Transformer (GPT) predominantly consist of English-language texts, but LLMs could be used across the globe to support diagnostics if language barriers could be overcome. Initial pilot studies on the utility of LLMs for differential diagnosis in languages other than English have shown promise, but a large-scale assessment on the relative performance of these models in a variety of European and non-European languages on a comprehensive corpus of challenging rare-disease cases is lacking.

Methods

We created 4967 clinical vignettes using structured d

SUBMITTER: Chimirri L 

PROVIDER: S-EPMC11888497 | biostudies-literature | 2025 Feb

REPOSITORIES: biostudies-literature