Aligning Large Language Models with Humans: A Comprehensive Survey of ChatGPT's Aptitude in Pharmacology.

ABSTRACT:

Background

Due to the lack of a comprehensive pharmacology test set, evaluating the potential and value of large language models (LLMs) in pharmacology is complex and challenging.

Aims

This study aims to provide a test set reference for assessing the application potential of both general-purpose and specialized LLMs in pharmacology.

Methods

We constructed a pharmacology test set consisting of three tasks: drug information retrieval, lead compound structure optimization, and research trend summarization and analysis. Subsequently, we compared the performance of general-purpose LLMs GPT-3.5 and GPT-4 on this test set.

Results

The results indicate that GPT-3.5 and GPT-4 can better understand instructions for information retrieval, scheme optimization, and trend su

SUBMITTER: Zhang Y 

PROVIDER: S-EPMC11802629 | biostudies-literature | 2025 Feb

REPOSITORIES: biostudies-literature