Comparing the performance of a large language model and naive human interviewers in interviewing children about a witnessed mock-event.

ABSTRACT:

Purpose

The present study compared the performance of a Large Language Model (LLM; ChatGPT) and human interviewers in interviewing children about a mock-event they witnessed.

Methods

Children aged 6-8 (N =  78) were randomly assigned to the LLM (n =  40) or the human interviewer condition (n =  38). In the experiment, the children were asked to watch a video filmed by the researchers that depicted behavior including elements that could be misinterpreted as abusive in other contexts, and then answer questions posed by either an LLM (presented by a human researcher) or a human interviewer.

Results

Irrespective of condition, recommended (vs. not recommended) questions elicited more correct information. The LLM posed fewer questions overall, but no difference in the propo

SUBMITTER: Sun Y 

PROVIDER: S-EPMC11870376 | biostudies-literature | 2025

REPOSITORIES: biostudies-literature