Performance of the Large Language Model ChatGPT on the National Nurse Examinations in Japan: Evaluation Study.

ABSTRACT:

Background

ChatGPT, a large language model, has shown good performance on physician certification examinations and medical consultations. However, its performance has not been examined in languages other than English or on nursing examinations.

Objective

We aimed to evaluate the performance of ChatGPT on the Japanese National Nurse Examinations.

Methods

We evaluated the percentages of correct answers provided by ChatGPT (GPT-3.5) for all questions on the Japanese National Nurse Examinations from 2019 to 2023, excluding inappropriate questions and those containing images. Inappropriate questions were pointed out by a third-party organization and announced by the government to be excluded from scoring. Specifically, these include "questions with inappropriate question d

SUBMITTER: Taira K 

PROVIDER: S-EPMC10337249 | biostudies-literature | 2023 Jun

REPOSITORIES: biostudies-literature