Diagnostic performance of four AI tools in pharmacology MCQs: Accuracy, sensitivity, and specificity.

ABSTRACT:

Background

The rapid rise of AI in medical and pharmaceutical education has engendered much interest; however, a knowledge gap still exists in the evaluation of performances of these tools in critical academic contexts.

Objectives

The aim of this study was to assess and compare the performances of four openly accessible AI language tools, Microsoft Copilot, ChatGPT-3.5, Google Gemini, and DeepSeek AI, in responding to pharmacology-related MCQs with regard to diagnostic accuracy, sensitivity, specificity, and reproducibility.

Methods

A total of 80 MCQs were generated and validated, representing four therapeutic systems: cardiovascular, respiratory, gastrointestinal, and endocrine, including four pharmacological domains: mechanism of action, side effects, pharmacokineti

SUBMITTER: Al-Rahahleh AJ 

PROVIDER: S-EPMC12707663 | biostudies-literature | 2025

REPOSITORIES: biostudies-literature