Performance of Large Language Models on the Korean Dental Licensing Examination: A Comparative Study.

ABSTRACT:

Purpose

This study investigated the potential application of large language models (LLMs) in dental education and practice, with a focus on ChatGPT and Claude3-Opus. Using the Korean Dental Licensing Examination (KDLE) as a benchmark, we aimed to assess the capabilities of these models in the dental field.

Methods

This study evaluated three LLMs: GPT-3.5, GPT-4 (version: March 2024), and Claude3-Opus (version: March 2024). We used the KDLE questionnaire from 2019 to 2023 as inputs to the LLMs and then used the outputs from the LLMs as the corresponding answers. The total scores for individual subjects were obtained and compared. We also compared the performance of LLMs with those of individuals who underwent the exams.

Results

Claude3-Opus performed best among the con

SUBMITTER: Kim W 

PROVIDER: S-EPMC11806296 | biostudies-literature | 2025 Feb

REPOSITORIES: biostudies-literature