Unknown

Dataset Information

0

Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study

ABSTRACT: This study aimed to compare the knowledge and interpretation ability of ChatGPT, a language model of artificial general intelligence, with those of medical students in Korea by administering a parasitology examination to both ChatGPT and medical students. The examination consisted of 79 items and was administered to ChatGPT on January 1, 2023. The examination results were analyzed in terms of ChatGPT’s overall performance score, its correct answer rate by the items’ knowledge level, and the acceptability of its explanations of the items. ChatGPT’s performance was lower than that of the medical students, and ChatGPT’s correct answer rate was not related to the items’ knowledge level. However, there was a relationship between acceptable explanations and correct answers. In conclusion, ChatGPT’s knowledge and interpretation ability for this parasitology examination were not yet comparable to those of medical students in Korea.

SUBMITTER: Huh S 

PROVIDER: S-EPMC9905868 | biostudies-literature | 2023

REPOSITORIES: biostudies-literature

Json Xml
altmetric image

Publications

Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study

Huh Sun S  

Journal of educational evaluation for health professions 20230111

This study aimed to compare the knowledge and interpretation ability of ChatGPT, a language model of artificial general intelligence, with those of medical students in Korea by administering a parasitology examination to both ChatGPT and medical students. The examination consisted of 79 items and was administered to ChatGPT on January 1, 2023. The examination results were analyzed in terms of ChatGPT’s overall performance score, its correct answer rate by the items’ knowledge level, and the acce  ...[more]

Similar Datasets

Unknown Use of Eye-Tracking Technology by Medical Students Taking the Objective Structured Clinical Examination: Descriptive Study.
| S-EPMC7500558 | biostudies-literature
Unknown Note-Taking Skill Among Bilingual Students in Academia: Literacy, Language and Cognitive Examination.
| S-EPMC6527783 | biostudies-literature
Unknown Examination performances of German and international medical students in the preclinical studying-term--a descriptive study.
| S-EPMC4152993 | biostudies-literature
Unknown Comparison of Assessment by a Virtual Patient and by Clinician-Educators of Medical Students' History-Taking Skills: Exploratory Descriptive Study.
| S-EPMC7099396 | biostudies-literature
Unknown Exploring the interest of medical students in global health in South Korea: Does taking a global health course matter?
| S-EPMC10566093 | biostudies-literature
Unknown ChatGPT (GPT-4) passed the Japanese National License Examination for Pharmacists in 2022, answering all items including those with diagrams: a descriptive study.
| S-EPMC10948916 | biostudies-literature
Unknown The interrater reliability of an objective structured practical examination in measuring the clinical reasoning ability of chiropractic students.
| S-EPMC5067129 | biostudies-literature
Unknown Testing risk-taking behavior in Chinese undergraduate students.
| S-EPMC4024034 | biostudies-other
Unknown Plant traits and decomposition: are the relationships for roots comparable to those for leaves?
| S-EPMC3268542 | biostudies-literature
Unknown Can ChatGPT generate surgical multiple-choice questions comparable to those written by a surgeon?
| S-EPMC11657069 | biostudies-literature