Evaluating the Efficacy of ChatGPT in Navigating the Spanish Medical Residency Entrance Examination (MIR): Promising Horizons for AI in Clinical Medicine.

ABSTRACT: The rapid progress in artificial intelligence, machine learning, and natural language processing has led to increasingly sophisticated large language models (LLMs) for use in healthcare. This study assesses the performance of two LLMs, the GPT-3.5 and GPT-4 models, in passing the MIR medical examination for access to medical specialist training in Spain. Our objectives included gauging the model's overall performance, analyzing discrepancies across different medical specialties, discerning between theoretical and practical questions, estimating error proportions, and assessing the hypothetical severity of errors committed by a physician.

Material and methods

We studied the 2022 Spanish MIR examination results after excluding those questions requiring image evaluations or having ackn

SUBMITTER: Guillen-Grima F 

PROVIDER: S-EPMC10660543 | biostudies-literature | 2023 Nov

REPOSITORIES: biostudies-literature