CLIP-based multimodal endorectal ultrasound enhances prediction of neoadjuvant chemoradiotherapy response in locally advanced rectal cancer.

ABSTRACT:

Background

Forecasting the patient's response to neoadjuvant chemoradiotherapy (nCRT) is crucial for managing locally advanced rectal cancer (LARC). This study investigates whether a predictive model using image-text features extracted from endorectal ultrasound (ERUS) via Contrastive Language-Image Pretraining (CLIP) can predict tumor regression grade (TRG) before nCRT.

Methods

A retrospective analysis of 577 LARC patients who received nCRT followed by surgery was conducted from January 2018 to December 2023. ERUS scans and TRG were used to assess nCRT response, categorizing patients into good (TRG 0) and poor (TRG 1-3) responders. Image and text features were extracted using the ResNet50+RBT3 (RN50) and ViT-B/16+RoBERTa-wwm (VB16) components of the Chinese-CLIP model. Ligh

SUBMITTER: Zhang H 

PROVIDER: S-EPMC11633952 | biostudies-literature | 2024

REPOSITORIES: biostudies-literature