The role of large language models in self-care: a study and benchmark on medicines and supplement guidance accuracy.

ABSTRACT:

Background

The recent surge in the capabilities of artificial intelligence systems, particularly large language models, is also impacting the medical and pharmaceutical field in a major way. Beyond specialized uses in diagnostics and data discovery, these tools have now become accessible to the general public.

Aim

The study aimed to critically analyse the current performance of large language models in answering patient's self-care questions regarding medications and supplements.

Method

Answers from six major language models were analysed for correctness, language-independence, context-sensitivity, and reproducibility using a newly developed reference set of questions and a scoring matrix.

Results

The investigated large language models are capable of answering

SUBMITTER: De Busser B 

PROVIDER: S-EPMC12335388 | biostudies-literature | 2025 Aug

REPOSITORIES: biostudies-literature