Comparative Evaluation of Large Language Models in Explaining Radiology Reports: Expert Assessment of Readability, Understandability, and Communication Features.

ABSTRACT:

Objectives

To compare understandability, readability, and communication characteristics of radiology report explanations generated by three freely accessible large language models-ChatGPT, Gemini, and Copilot-based on a standardized prompt, as assessed by expert reviewers.

Materials and methods

In this retrospective single-center study, 100 anonymized radiology reports were randomly selected from five subspecialties. Each report was submitted to ChatGPT (GPT-3.5), Gemini, and Copilot between May 23 and May 30, 2025, using the prompt, "Can you explain my radiology report?". Responses were evaluated for medical correctness on a 3-point scale (0-2), understandability using the patient education materials assessment tool for understandability (PEMAT-U), and readability using Fle

SUBMITTER: Bozer A 

PROVIDER: S-EPMC12572556 | biostudies-literature | 2025 Oct

REPOSITORIES: biostudies-literature