Evaluation framework for conversational agents with artificial intelligence in health interventions: a systematic scoping review.

ABSTRACT:

Objectives

Conversational agents (CAs) with emerging artificial intelligence present new opportunities to assist in health interventions but are difficult to evaluate, deterring their applications in the real world. We aimed to synthesize existing evidence and knowledge and outline an evaluation framework for CA interventions.

Materials and methods

We conducted a systematic scoping review to investigate designs and outcome measures used in the studies that evaluated CAs for health interventions. We then nested the results into an overarching digital health framework proposed by the World Health Organization (WHO).

Results

The review included 81 studies evaluating CAs in experimental (n = 59), observational (n = 15) trials, and other research designs (n = 7). Most stud

SUBMITTER: Ding H 

PROVIDER: S-EPMC10873847 | biostudies-literature | 2024 Feb

REPOSITORIES: biostudies-literature