Performance of GPT-4o combined with retrieval-augmented generation on nutritionist licensing exam questions.

ABSTRACT: GPT-4o, a general-purpose large language model, has a Retrieval-Augmented Variant (GPT-4o-RAG) that can assist in dietary counseling. However, research on its application in this field remains lacking. To bridge this gap, we used the Japanese National Examination for Registered Dietitians as a standardized benchmark for evaluation. Three language models-GPT-4o, GPT-4o-mini, and GPT-4o-RAG-were assessed using 599 publicly available multiple-choice questions from the 2022-2024 national examinations. For each model, we generated answers to each question five times and based our evaluation on these multiple outputs to assess response variability and robustness. A custom pipeline was implemented for GPT-4o-RAG to retrieve guideline-based documents for integration with GPT-generated responses. A

SUBMITTER: Ishikawa Y 

PROVIDER: S-EPMC12702670 | biostudies-literature | 2025 Dec

REPOSITORIES: biostudies-literature