Evaluation of Six Large Language Models for Clinical Decision Support: Application in Transfusion Decision-making for RhD Blood-type Patients.

ABSTRACT:

Background

: Large language models (LLMs) have the potential for clinical decision support; however, their use in specific tasks, such as determining the RhD blood type for transfusion, remains underexplored. Therefore, we evaluated the accuracy of six LLMs in addressing RhD blood type-related issues in Korean healthcare.

Methods

: Fifteen multiple-choice and true/false questions, based on real-world transfusion scenarios and reviewed by specialists, were developed. The questions were administered twice to six LLMs (Clova X, Gemini 1.0, Gemini 1.5, ChatGPT-3.5, GPT-4.0, and GPT-4o) in both Korean and English.

Results

were compared against the performance of 22 transfusion medicine experts. For particularly challenging questions, prompt engineering was applied, and the

SUBMITTER: Lee JK 

PROVIDER: S-EPMC12370811 | biostudies-literature | 2025 Sep

REPOSITORIES: biostudies-literature