Testing the knowledge of artificial intelligence chatbots in pharmacology: examples of two groups of drugs.

ABSTRACT:

Objectives

The study aimed to evaluate eight artificial intelligence chatbots (ChatGPT-3.5, Microsoft Copilot, Gemini, You.com, Perplexity, Character.ai, Claude 3.5, and ChatRTX) in answering questions related to two pharmacological topics taught during the basic pharmacology curriculum for medical students: antifungal drugs and hypolipidemic drugs.

Methods

Chatbots' performance was assessed by answering 60 single-choice questions on antifungal and hypolipidemic drugs topics. The questions were designed to have four answers (a, b, c, and d), and the artificial intelligence (AI) role was to choose the proper one. The assessment was performed twice with a 1-year hiatus to determine if artificial intelligence chatbots' effectiveness changed over time. All the answers were check

SUBMITTER: Granat MM 

PROVIDER: S-EPMC12453646 | biostudies-literature | 2025

REPOSITORIES: biostudies-literature