Standardizing and Scaffolding Health Care AI-Chatbot Evaluation: Systematic Review.

ABSTRACT:

Background

Health care chatbots are rapidly proliferating, while generative artificial intelligence (AI) outpaces existing evaluation standards.

Objective

We aimed to develop a structured, stakeholder-informed framework to standardize evaluation of health care chatbots.

Methods

PRISMA (Preferred Reporting Items for Systematic reviews and Meta-Analyses)-guided searches across multiple databases identified 266 records; 152 were screened, 21 full texts were assessed, and 11 frameworks were included. We extracted 356 questions (refined to 271 by deduplication and relevance review), mapped items to Coalition for Health AI constructs, and organized them with iterative input from clinicians, patients, developers, epidemiologists, and policymakers.

Results

We developed

SUBMITTER: Hua Y 

PROVIDER: S-EPMC12639340 | biostudies-literature | 2025 Nov

REPOSITORIES: biostudies-literature