Evaluating the quality of large language model-generated preoperative patient education material: a comparative study across models and surgery types.

ABSTRACT:

Background

Numerous studies have confirmed the effectiveness of large language models (LLMs) as a patient education tool; however, these studies primarily relied on the method of asking medical questions. So far, no studies have comprehensively assessed the quality of the complete preoperative patient education material (PEM) generated by LLMs from the perspectives of different models and surgical types.

Objective

This study aims to comprehensively assess and compare the quality of different types of complete preoperative PEM generated by six common LLMs.

Design

A Cross-sectional Comparative Study.

Methods

We prompted 6 LLMs to generate preoperative PEMs for 6 distinct surgical types. For each surgical type, the materials were evaluated by 3 groups of experts f

SUBMITTER: Ma J 

PROVIDER: S-EPMC12738167 | biostudies-literature | 2025

REPOSITORIES: biostudies-literature