Benchmarking GPT-5 in radiation oncology: measurable gains, but persistent need for expert oversight.

ABSTRACT:

Introduction

Large language models (LLM) have shown great potential in clinical decision support and medical education. GPT-5 is a novel LLM system that has been specifically marketed towards oncology use. This study comprehensively benchmarks GPT-5 for the field of radiation oncology.

Methods

Performance was assessed using two complementary benchmarks: (i) the American College of Radiology Radiation Oncology In-Training Examination (TXIT, 2021), comprising 300 multiple-choice items, and (ii) a curated set of 60 authentic radiation oncologic vignettes representing diverse disease sites and treatment indications. For the vignette evaluation, GPT-5 was instructed to generate structured therapeutic plans and concise two-line summaries. Four board-certified radiation oncologists

SUBMITTER: Dinc US 

PROVIDER: S-EPMC12738326 | biostudies-literature | 2025

REPOSITORIES: biostudies-literature