Dataset Information

Transfer learning-based PET/CT three-dimensional convolutional neural network fusion of image and clinical information for prediction of EGFR mutation in lung adenocarcinoma.

ABSTRACT:

Background

To introduce a three-dimensional convolutional neural network (3D CNN) leveraging transfer learning for fusing PET/CT images and clinical data to predict EGFR mutation status in lung adenocarcinoma (LADC).

Methods

Retrospective data from 516 LADC patients, encompassing preoperative PET/CT images, clinical information, and EGFR mutation status, were divided into training (n = 404) and test sets (n = 112). Several deep learning models were developed utilizing transfer learning, involving CT-only and PET-only models. A dual-stream model fusing PET and CT and a three-stream transfer learning model (TS_TL) integrating clinical data were also developed. Image preprocessing includes semi-automatic segmentation, resampling, and image cropping. Considering the impact of class imbalance, the performance of the model was evaluated using ROC curves and AUC values.

Results

TS_TL model demonstrated promising performance in predicting the EGFR mutation status, with an AUC of 0.883 (95%CI = 0.849-0.917) in the training set and 0.730 (95%CI = 0.629-0.830) in the independent test set. Particularly in advanced LADC, the model achieved an AUC of 0.871 (95%CI = 0.823-0.919) in the training set and 0.760 (95%CI = 0.638-0.881) in the test set. The model identified distinct activation areas in solid or subsolid lesions associated with wild and mutant types. Additionally, the patterns captured by the model were significantly altered by effective tyrosine kinase inhibitors treatment, leading to notable changes in predicted mutation probabilities.

Conclusion

PET/CT deep learning model can act as a tool for predicting EGFR mutation in LADC. Additionally, it offers clinicians insights for treatment decisions through evaluations both before and after treatment.

SUBMITTER: Shao X

PROVIDER: S-EPMC10913633 | biostudies-literature | 2024 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Transfer learning-based PET/CT three-dimensional convolutional neural network fusion of image and clinical information for prediction of EGFR mutation in lung adenocarcinoma.

Shao Xiaonan X Ge Xinyu X Gao Jianxiong J Niu Rong R Shi Yunmei Y Shao Xiaoliang X Jiang Zhenxing Z Li Renyuan R Wang Yuetao Y

BMC medical imaging 20240304 1

<h4>Background</h4>To introduce a three-dimensional convolutional neural network (3D CNN) leveraging transfer learning for fusing PET/CT images and clinical data to predict EGFR mutation status in lung adenocarcinoma (LADC).<h4>Methods</h4>Retrospective data from 516 LADC patients, encompassing preoperative PET/CT images, clinical information, and EGFR mutation status, were divided into training (n = 404) and test sets (n = 112). Several deep learning models were developed utilizing transfer lea ...[more]

PMID: 38438844

Similar Datasets

Project description:The limited resolution and lack of spatial information in positron emission tomography (PET) images require the complementary anatomic information from the computed tomography (CT) and/or magnetic resonance imaging (MRI). Therefore, multimodality image fusion techniques such as PET/CT are critical in mapping the functional images to structural images and thus facilitate the interpretation of PET studies. In our experimental situation, the CT and PET images are acquired in separate scanners at different times and the inherent differences in the imaging protocols produce significant nonrigid changes between the two acquisitions in addition to dissimilar image characteristics. The registration conditions are also poor because CT images have artifacts due to the limitation of current scanning settings, while PET images are very blurry (in transmission-PET) and have vague anatomical structure boundaries (in emission-PET).The authors present a new method for whole body small animal multimodal registration. In particular, the authors register whole body rat CT image and PET images using a weighted demons algorithm. The authors use both the transmission-PET and the emission-PET images in the registration process emphasizing particular regions of the moving transmission-PET image using the emission-PET image. After a rigid transformation and a histogram matching between the CT and the transmission-PET images, the authors deformably register the transmission-PET image to the CT image with weights based on the intensity-normalized emission-PET image. For the deformable registration process, the authors develop a weighted demons registration method that can give preferences to particular regions of the input image using a weight image.The authors validate the results with nine rat image sets using the M-Hausdorff distance (M-HD) similarity measure with different outlier-suppression parameters (OSP). In comparison with standard methods such as the regular demons and the normalized mutual information (NMI)-based nonrigid free-form deformation (FFD) registration, the proposed weighted demons registration method shows average M-HD errors: 3.99 ± 1.37 (OSP = 10), 5.04 ± 1.59 (OSP = 20) and 5.92 ± 1.61 (OSP = ∞) with statistical significance (p < 0.0003) respectively, while NMI-based nonrigid FFD has average M-HD errors: 5.74 ± 1.73 (OSP = 10), 7.40 ± 7.84 (OSP = 20) and 9.83 ± 4.13 (OSP = ∞), and the regular demons has average M-HD errors: 6.79 ± 0.83 (OSP = 10), 9.19 ± 2.39 (OSP = 20) and 11.63 ± 3.99 (OSP = ∞), respectively. In addition to M-HD comparisons, the visual comparisons on the faint-edged region between the CT and the aligned PET images also show the encouraging improvements over the other methods.In the whole body multimodal registration between CT and PET images, the utilization of both the transmission-PET and the emission-PET images in the registration process by emphasizing particular regions of the transmission-PET image using an emission-PET image is effective. This method holds promise for other image fusion applications where multiple (more than two) input images should be registered into a single informative image.

Project description:BackgroundIdentification of epidermal growth factor receptor (EGFR) mutation types is crucial before tyrosine kinase inhibitors (TKIs) treatment. Radiomics is a new strategy to noninvasively predict the genetic status of cancer. In this study, we aimed to develop a predictive model based on 18F-fluorodeoxyglucose positron emission tomography-computed tomography (18F-FDG PET/CT) radiomic features to identify the specific EGFR mutation subtypes.MethodsWe retrospectively studied 18F-FDG PET/CT images of 148 patients with isolated lung lesions, which were scanned in two hospitals with different CT scan setting (slice thickness: 3 and 5 mm, respectively). The tumor regions were manually segmented on PET/CT images, and 1,570 radiomic features (1,470 from CT and 100 from PET) were extracted from the tumor regions. Seven hundred and ninety-four radiomic features insensitive to different CT settings were first selected using the Mann white U test, and collinear features were further removed from them by recursively calculating the variation inflation factor. Then, multiple supervised machine learning models were applied to identify prognostic radiomic features through: (I) a multi-variate random forest to select features of high importance in discriminating different EGFR mutation status; (II) a logistic regression model to select features of the highest predictive value of the EGFR subtypes. The EGFR mutation predicting model was constructed from prognostic radiomic features using the popular Xgboost machine-learning algorithm and validated using 3-fold cross-validation. The performance of predicting model was analyzed using the receiver operating characteristic curve (ROC) and measured with the area under the curve (AUC).ResultsTwo sets of prognostic radiomic features were found for specific EGFR mutation subtypes: 5 radiomic features for EGFR exon 19 deletions, and 5 radiomic features for EGFR exon 21 L858R missense. The corresponding radiomic predictors achieved the prediction accuracies of 0.77 and 0.92 in terms of AUC, respectively. Combing these two predictors, the overall model for predicting EGFR mutation positivity was also constructed, and the AUC was 0.87.ConclusionsIn our study, we established predictive models based on radiomic analysis of 18F-FDG PET/CT images. And it achieved a satisfying prediction power in the identification of EGFR mutation status as well as the certain EGFR mutation subtypes in lung cancer.

Dataset Information

Transfer learning-based PET/CT three-dimensional convolutional neural network fusion of image and clinical information for prediction of EGFR mutation in lung adenocarcinoma.

Background

Methods

Results

Conclusion

Publications

Transfer learning-based PET/CT three-dimensional convolutional neural network fusion of image and clinical information for prediction of EGFR mutation in lung adenocarcinoma.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets