Evaluating the evidence-based potential of six large language models in paediatric dentistry: a comparative study on generative artificial intelligence.

ABSTRACT:

Purpose

The use of large language models (LLMs) in generative artificial intelligence (AI) is rapidly increasing in dentistry. However, their reliability is yet to be fully founded. This study aims to evaluate the diagnostic accuracy, clinical applicability, and patient education potential of LLMs in paediatric dentistry, by evaluating the responses of six LLMs: Google AI's Gemini and Gemini Advanced, OpenAI's ChatGPT-3.5, -4o and -4, and Microsoft's Copilot.

Methods

Ten open-type clinical questions, relevant to paediatric dentistry were posed to the LLMs. The responses were graded by two independent evaluators from 0 to 10 using a detailed rubric. After 4 weeks, answers were reevaluated to assess intra-evaluator reliability. Statistical comparisons used Friedman's and Wilco

SUBMITTER: Dermata A 

PROVIDER: S-EPMC12165978 | biostudies-literature | 2025 Jun

REPOSITORIES: biostudies-literature