Dataset Information

A comparison of machine learning methods for radiomics modeling in prediction of occult lymph node metastasis in clinical stage IA lung adenocarcinoma patients.

ABSTRACT:

Background

Accurate prediction of occult lymph node metastasis (ONM) is an important basis for determining whether lymph node (LN) dissection is necessary in clinical stage IA lung adenocarcinoma patients. The aim of this study is to determine the best machine learning algorithm for radiomics modeling and to compare the performances of the radiomics model, the clinical-radilogical model and the combined model incorporate both radiomics features and clinical-radilogical features in preoperatively predicting ONM in clinical stage IA lung adenocarcinoma patients.

Methods

Patients with clinical stage IA lung adenocarcinoma undergoing curative surgery from one institution were retrospectively recruited and assigned to training and test cohorts. Radiomics features were extracted from the preoperative computed tomography (CT) images of the primary tumor. Seven machine learning algorithms were used to construct radiomics models, and the model with the best performance, evaluated using the area under the curve (AUC), was selected. Univariate and multivariate logistic regression analyses were performed on the clinical-radiological features to identify statistically significant features and to develop a clinical model. The optimal radiomics and clinical models were integrated to build a combined model, and its predictive performance was assessed using receiver operating characteristic curves, Brier score, and decision curve analysis (DCA).

Results

This study included 258 patients who underwent resection (training cohort, n=182; test cohort, n=76). Six radiomics features were identified. Among the seven machine learning algorithms, extreme gradient boosting (XGB) demonstrated the highest performance for radiomics modeling, with an AUC of 0.917. The combined model improved the AUC to 0.933 and achieved a Brier score of 0.092. DCA revealed that the combined model had optimal clinical efficacy.

Conclusions

The superior performance of the combined model, based on XGB algorithm in predicting ONM in patients with clinical stage IA lung adenocarcinoma, might aid surgeons in deciding whether to conduct mediastinal LN dissection and contribute to improve patients' prognosis.

SUBMITTER: Liu MW

PROVIDER: S-EPMC11009592 | biostudies-literature | 2024 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A comparison of machine learning methods for radiomics modeling in prediction of occult lymph node metastasis in clinical stage IA lung adenocarcinoma patients.

Liu Meng-Wen MW Zhang Xue X Wang Yan-Mei YM Jiang Xu X Jiang Jiu-Ming JM Li Meng M Zhang Li L

Journal of thoracic disease 20240327 3

<h4>Background</h4>Accurate prediction of occult lymph node metastasis (ONM) is an important basis for determining whether lymph node (LN) dissection is necessary in clinical stage IA lung adenocarcinoma patients. The aim of this study is to determine the best machine learning algorithm for radiomics modeling and to compare the performances of the radiomics model, the clinical-radilogical model and the combined model incorporate both radiomics features and clinical-radilogical features in preope ...[more]

PMID: 38617761

Similar Datasets

Project description:ObjectiveThe neglect of occult lymph nodes metastasis (OLNM) is one of the pivotal causes of early non-small cell lung cancer (NSCLC) recurrence after local treatments such as stereotactic body radiotherapy (SBRT) or surgery. This study aimed to develop and validate a computed tomography (CT)-based radiomics and deep learning (DL) fusion model for predicting non-invasive OLNM.MethodsPatients with radiologically node-negative lung adenocarcinoma from two centers were retrospectively analyzed. We developed clinical, radiomics, and radiomics-clinical models using logistic regression. A DL model was established using a three-dimensional squeeze-and-excitation residual network-34 (3D SE-ResNet34) and a fusion model was created by integrating seleted clinical, radiomics features and DL features. Model performance was assessed using the area under the curve (AUC) of the receiver operating characteristic (ROC) curve, calibration curves, and decision curve analysis (DCA). Five predictive models were compared; SHapley Additive exPlanations (SHAP) and Gradient-weighted Class Activation Mapping (Grad-CAM) were employed for visualization and interpretation.ResultsOverall, 358 patients were included: 186 in the training cohort, 48 in the internal validation cohort, and 124 in the external testing cohort. The DL fusion model incorporating 3D SE-Resnet34 achieved the highest AUC of 0.947 in the training dataset, with strong performance in internal and external cohorts (AUCs of 0.903 and 0.907, respectively), outperforming single-modal DL models, clinical models, radiomics models, and radiomics-clinical combined models (DeLong test: P<0.05). DCA confirmed its clinical utility, and calibration curves demonstrated excellent agreement between predicted and observed OLNM probabilities. Features interpretation highlighted the importance of textural characteristics and the surrounding tumor regions in stratifying OLNM risk.ConclusionsThe DL fusion model reliably and accurately predicts OLNM in early-stage lung adenocarcinoma, offering a non-invasive tool to refine staging and guide personalized treatment decisions. These results may aid clinicians in optimizing surgical and radiotherapy strategies.

Project description:ObjectivesTo develop and validate the imbalanced data correction based PET/CT radiomics model for predicting lymph node metastasis (LNM) in clinical stage T1 lung adenocarcinoma (LUAD).MethodsA total of 183 patients (148/35 non-metastasis/LNM) with pathologically confirmed LUAD were retrospectively included. The cohorts were divided into training vs. validation cohort in a ratio of 7:3. A total of 487 radiomics features were extracted from PET and CT components separately for radiomics model construction. Four clinical features and seven PET/CT radiological features were extracted for traditional model construction. To balance the distribution of majority (non-metastasis) class and minority (LNM) class, the imbalance-adjustment strategies using ten data re-sampling methods were adopted. Three multivariate models (denoted as Traditional, Radiomics, and Combined) were constructed using multivariable logistic regression analysis, where the combined model incorporated all of the significant clinical, radiological, and radiomics features. One hundred times repeated Monte Carlo cross-validation was used to assess the application order of feature selection and imbalance-adjustment strategies in the machine learning pipeline. Prediction performance of each model was evaluated using the area under the receiver operating characteristic curve (AUC) and Geometric mean score (G-mean).ResultsA total of 2 clinical parameters, 2 radiological features, 3 PET, and 5 CT radiomics features were significantly associated with LNM. The combined model with Edited Nearest Neighbors (ENN) re-sampling methods showed strong prediction performance than traditional model or radiomics model with the AUC of 0.94 (95%CI = 0.86-0.97) vs. 0.89 (95%CI = 0.79-0.93), 0.92 (95%CI = 0.85-0.97), and G-mean of 0.88 vs. 0.82, 0.80 in the training cohort, and the AUC of 0.75 (95%CI = 0.57-0.91) vs. 0.68 (95%CI = 0.36-0.83), 0.71 (95%CI = 0.48-0.83) and G-mean of 0.76 vs. 0.64, 0.51 in the validation cohort. The combination of performing feature selection before data re-sampling obtains a better result than the reverse combination (AUC 0.76 ± 0.06 vs. 0.70 ± 0.07, p<0.001).ConclusionsThe combined model (consisting of age, histological type, C/T ratio, MATV, and radiomics signature) integrated with ENN re-sampling methods had strong lymph node metastasis prediction performance for imbalance cohorts in clinical stage T1 LUAD. Radiomics signatures extracted from PET/CT images could provide complementary prediction information compared with traditional model.

Project description:BackgroundTo explored the value of CT-measured body composition radiomics in preoperative evaluation of lymph node metastasis (LNM) in localized pancreatic ductal adenocarcinoma (LPDAC).MethodsWe retrospectively collected patients with LPDAC who underwent surgical resection from January 2016 to June 2022. According to whether there was LNM after operation, the patients were divided into LNM group and non-LNM group in both male and female patients. The patient's body composition was measured by CT images at the level of the L3 vertebral body before surgery, and the radiomics features of adipose tissue and muscle were extracted. Multivariate logistic regression (forward LR) analyses were used to determine the predictors of LNM from male and female patient, respectively. Sexual dimorphism prediction signature using adipose tissue radiomics features, muscle tissue radiomics features and combined signature of both were developed and compared. The model performance is evaluated on discrimination and validated through a leave-one-out cross-validation method.ResultsA total of 196 patients (mean age, 60 years ± 9 [SD]; 117 men) were enrolled, including 59 LNM in male and 36 LNM in female. Both male and female CT-measured body composition radiomics signatures have a certain predictive power on LNM of LPDAC. Among them, the female adipose tissue signature showed the highest performance (area under the ROC curve (AUC), 0.895), and leave one out cross validation (LOOCV) indicated that the signature could accurately classify 83.5% of cases; The prediction efficiency of the signature can be further improved after adding the muscle radiomics features (AUC, 0.924, and the accuracy of the LOOCV was 87.3%); The abilities of male adipose tissue and muscle tissue radiomics signatures in predicting LNM of LPDAC was similar, AUC was 0.735 and 0.773, respectively, and the accuracy of LOOCV was 62.4% and 68.4%, respectively.ConclusionsCT-measured body composition Radiomics strategy showed good performance for predicting LNM in LPDAC, and has sexual dimorphism. It may provide a reference for individual treatment of LPDAC and related research about body composition in the future.

Project description:BackgroundWith the popularization of lung cancer screening, more early-stage lung cancers are being detected. This study aims to compare three types of N classifications, including location-based N classification (pathologic nodal classification [pN]), the number of lymph node stations (nS)-based N classification (nS classification), and the combined approach proposed by the International Association for the Study of Lung Cancer (IASLC) which incorporates both pN and nS classification to determine if the nS classification is more appropriate for early-stage lung cancer.MethodsWe retrospectively reviewed the clinical data of lung cancer patients treated at the Cancer Hospital, Chinese Academy of Medical Sciences between 2005 and 2018. Inclusion criteria was clinical stage IA lung adenocarcinoma patients who underwent resection during this period. Sub-analyses were performed for the three types of N classifications. The optimal cutoff values for nS classification were determined with X-tile software. Kaplan‒Meier and multivariate Cox analyses were performed to assess the prognostic significance of the different N classifications. The prediction performance among the three types of N classifications was compared using the concordance index (C-index) and decision curve analysis (DCA).ResultsOf the 669 patients evaluated, 534 had pathological stage N0 disease (79.8%), 82 had N1 disease (12.3%) and 53 had N2 disease (7.9%). Multivariate Cox analysis indicated that all three types of N classifications were independent prognostic factors for prognosis (all P < 0.001). However, the prognosis overlaps between pN (N1 and N2, P = 0.052) and IASLC-proposed N classification (N1b and N2a1 [P = 0.407], N2a1 and N2a2 [P = 0.364], and N2a2 and N2b [P = 0.779]), except for nS classification subgroups (nS0 and nS1 [P < 0.001] and nS1 and nS >1 [P = 0.006]). There was no significant difference in the C-index values between the three N classifications (P = 0.370). The DCA results demonstrated that the nS classification provided greater clinical utility.ConclusionThe nS classification might be a better choice for nodal classification in clinical stage IA lung adenocarcinoma.

Project description:ObjectivesThis research aimed to assess the value of radiomics combined with multiple machine learning algorithms in the diagnosis of pancreatic ductal adenocarcinoma (PDAC) lymph node (LN) metastasis, which is expected to provide clinical treatment strategies.MethodsA total of 128 patients with pathologically confirmed PDAC and who underwent surgical resection were randomized into training (n=93) and validation (n=35) groups. This study incorporated a total of 13 distinct machine learning algorithms and explored 85 unique combinations of these algorithms. The area under the curve (AUC) of each model was computed. The model with the highest mean AUC was selected as the best model which was selected to determine the radiomics score (Radscore). The clinical factors were examined by the univariate and multivariate analysis, which allowed for the identification of factors suitable for clinical modeling. The multivariate logistic regression was used to create a combined model using Radscore and clinical variables. The diagnostic performance was assessed by receiver operating characteristic curves, calibration curves, and decision curve analysis (DCA).ResultsAmong the 233 models constructed using arterial phase (AP), venous phase (VP), and AP+VP radiomics features, the model built by applying AP+VP radiomics features and a combination of Lasso+Logistic algorithm had the highest mean AUC. A clinical model was eventually constructed using CA199 and tumor size. The combined model consisted of AP+VP-Radscore and two clinical factors that showed the best diagnostic efficiency in the training (AUC = 0.920) and validation (AUC = 0.866) cohorts. Regarding preoperative diagnosis of LN metastasis, the calibration curve and DCA demonstrated that the combined model had a good consistency and greatest net benefit.ConclusionsCombining radiomics and machine learning algorithms demonstrated the potential for identifying the LN metastasis of PDAC. As a non-invasive and efficient preoperative prediction tool, it can be beneficial for decision-making in clinical practice.

Dataset Information

A comparison of machine learning methods for radiomics modeling in prediction of occult lymph node metastasis in clinical stage IA lung adenocarcinoma patients.

Background

Methods

Results

Conclusions

Publications

A comparison of machine learning methods for radiomics modeling in prediction of occult lymph node metastasis in clinical stage IA lung adenocarcinoma patients.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets