Performance of Large Language Models on a Neurology Board-Style Examination.

ABSTRACT:

Importance

Recent advancements in large language models (LLMs) have shown potential in a wide array of applications, including health care. While LLMs showed heterogeneous results across specialized medical board examinations, the performance of these models in neurology board examinations remains unexplored.

Objective

To assess the performance of LLMs on neurology board-style examinations.

Design, setting, and participants

This cross-sectional study was conducted between May 17 and May 31, 2023. The evaluation utilized a question bank approved by the American Board of Psychiatry and Neurology and was validated with a small question cohort by the European Board for Neurology. All questions were categorized into lower-order (recall, understanding) and higher-order (app

SUBMITTER: Schubert MC 

PROVIDER: S-EPMC10704278 | biostudies-literature | 2023 Dec

REPOSITORIES: biostudies-literature