From accuracy to robustness: a comparative study of five advanced large language models on the Chinese dental licensing examination.

ABSTRACT:

Background

Large language models (LLMs) have demonstrated considerable promise in various domains, including dentistry. This study aimed to evaluate five advanced LLMs (DeepSeek-R1, GPT-4o, OpenAI o3, GPT-5 Thinking, and Gemini 2.5 Pro) in the context of the Chinese Dental Licensing Examination (CDLE) to explore their potential in dental education and practice.

Methods

A total of 600 questions were selected from the official review book provided by the Chinese National Medical Examination Center. All questions, presented in Chinese, were submitted individually to the five LLMs via their web interfaces. The responses were classified as "correct" or "incorrect" using the official answer keys provided by the review book. We analyzed and compared each model's overall accuracy an

SUBMITTER: Zhang J 

PROVIDER: S-EPMC12750740 | biostudies-literature | 2025 Dec

REPOSITORIES: biostudies-literature