Performance of Generative Pretrained Transformer on the National Medical Licensing Examination in Japan.

ABSTRACT: The remarkable performance of ChatGPT, launched in November 2022, has significantly impacted the field of natural language processing, inspiring the application of large language models as supportive tools in clinical practice and research worldwide. Although GPT-3.5 recently scored high on the United States Medical Licensing Examination, its performance on medical licensing examinations of other nations, especially non-English speaking nations, has not been sufficiently evaluated. This study assessed GPT's performance on the National Medical Licensing Examination (NMLE) in Japan and compared it with the actual minimal passing rate for this exam. In particular, the performances of both the GPT-3.5 and GPT-4 models were considered for the comparative analysis. We initially used the GPT mode

SUBMITTER: Tanaka Y 

PROVIDER: S-EPMC10805303 | biostudies-literature | 2024 Jan

REPOSITORIES: biostudies-literature