Assessment of Large Language Models (LLMs) in decision-making support for gynecologic oncology.

ABSTRACT:

Objective

This study investigated the ability of Large Language Models (LLMs) to provide accurate and consistent answers by focusing on their performance in complex gynecologic cancer cases.

Background

LLMs are advancing rapidly and require a thorough evaluation to ensure that they can be safely and effectively used in clinical decision-making. Such evaluations are essential for confirming LLM reliability and accuracy in supporting medical professionals in casework.

Study design

We assessed three prominent LLMs-ChatGPT-4 (CG-4), Gemini Advanced (GemAdv), and Copilot-evaluating their accuracy, consistency, and overall performance. Fifteen clinical vignettes of varying difficulty and five open-ended questions based on real patient cases were used. The responses were cod

SUBMITTER: Gumilar KE 

PROVIDER: S-EPMC11603009 | biostudies-literature | 2024 Dec

REPOSITORIES: biostudies-literature