How well do large language model-based chatbots perform in oral and maxillofacial radiology?

ABSTRACT:

Objectives

This study evaluated the performance of four large language model (LLM)-based chatbots by comparing their test results with those of dental students on an oral and maxillofacial radiology examination.

Methods

ChatGPT, ChatGPT Plus, Bard, and Bing Chat were tested on 52 questions from regular dental college examinations. These questions were categorized into three educational content areas: basic knowledge, imaging and equipment, and image interpretation. They were also classified as multiple-choice questions (MCQs) and short-answer questions (SAQs). The accuracy rates of the chatbots were compared with the performance of students, and further analysis was conducted based on the educational content and question type.

Results

The students' overall accuracy ra

SUBMITTER: Jeong H 

PROVIDER: S-EPMC11358622 | biostudies-literature | 2024 Sep

REPOSITORIES: biostudies-literature