Evaluation of Generative Language Models in Personalizing Medical Information: Instrument Validation Study.

ABSTRACT:

Background

Although uncertainties exist regarding implementation, artificial intelligence-driven generative language models (GLMs) have enormous potential in medicine. Deployment of GLMs could improve patient comprehension of clinical texts and improve low health literacy.

Objective

The goal of this study is to evaluate the potential of ChatGPT-3.5 and GPT-4 to tailor the complexity of medical information to patient-specific input education level, which is crucial if it is to serve as a tool in addressing low health literacy.

Methods

Input templates related to 2 prevalent chronic diseases-type II diabetes and hypertension-were designed. Each clinical vignette was adjusted for hypothetical patient education levels to evaluate output personalization. To assess the succe

SUBMITTER: Spina A 

PROVIDER: S-EPMC11350306 | biostudies-literature | 2024 Aug

REPOSITORIES: biostudies-literature