Evaluating ChatGPT's responses to vaccine-related questions: the impact of question framing on content and quality.

ABSTRACT:

Background

Vaccine hesitancy, fueled by mistrust, fear, and misinformation, remains a major public health challenge. Generative artificial intelligence tools such as ChatGPT have emerged as new information sources, particularly for younger users. It is essential that these tools provide medically accurate content, especially when responding to negatively framed vaccine questions. This study aims to examine how ChatGPT responds to vaccine-related questions, focusing on questions with negative or skeptical framing.

Methods

This anonymous survey targeted board-certified pediatric infectious disease specialists in Japan to evaluate ChatGPT's responses to vaccine-related questions. Using ChatGPT-4o, 20 question pairs (supportive vs. critical framing) were generated, and re

SUBMITTER: Kusama Y 

PROVIDER: S-EPMC12683428 | biostudies-literature | 2025 Nov

REPOSITORIES: biostudies-literature