Assessment of artificial intelligence chatbots in responding to dental occlusion questions: a comparative study.

ABSTRACT:

Background

Artificial intelligence (AI) chatbots, which use large language models (LLMs) to comprehend user questions and respond to human conversations, are increasingly used in dental education, but their accuracy in core subjects like occlusion remains unexplored. This study evaluated the performance of four AI chatbots, namely, Claude 3.7 Sonnet, GPT-4o, DeepSeek, and Meta LLaMA 3.2, in answering multiple-choice questions (MCQs) related to fundamentals of dental occlusion.

Methods

Each chatbot was tested across two rounds on a standardized set of MCQs taken from a textbook on dental occlusion. Accuracy, intra-model consistency, and inter-model agreement were assessed using descriptive statistics, Cohen's Kappa, and McNemar's test.

Results

Claude 3.7 sonnet and GPT

SUBMITTER: Alqahtani H 

PROVIDER: S-EPMC12859897 | biostudies-literature | 2025 Dec

REPOSITORIES: biostudies-literature