Dataset Information

Deep neural network trained on gigapixel images improves lymph node metastasis detection in clinical settings.

ABSTRACT: The pathological identification of lymph node (LN) metastasis is demanding and tedious. Although convolutional neural networks (CNNs) possess considerable potential in improving the process, the ultrahigh-resolution of whole slide images hinders the development of a clinically applicable solution. We design an artificial-intelligence-assisted LN assessment workflow to facilitate the routine counting of metastatic LNs. Unlike previous patch-based approaches, our proposed method trains CNNs by using 5-gigapixel images, obviating the need for lesion-level annotations. Trained on 5907 LN images, our algorithm identifies metastatic LNs in gastric cancer with a slide-level area under the receiver operating characteristic curve (AUC) of 0.9936. Clinical experiments reveal that the workflow significantly improves the sensitivity of micrometastasis identification (81.94% to 95.83%, P < .001) and isolated tumor cells (67.95% to 96.15%, P < .001) in a significantly shorter review time (-31.5%, P < .001). Cross-site evaluation indicates that the algorithm is highly robust (AUC = 0.9829).

SUBMITTER: Huang SC

PROVIDER: S-EPMC9187676 | biostudies-literature | 2022 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Deep neural network trained on gigapixel images improves lymph node metastasis detection in clinical settings.

Huang Shih-Chiang SC Chen Chi-Chung CC Lan Jui J Hsieh Tsan-Yu TY Chuang Huei-Chieh HC Chien Meng-Yao MY Ou Tao-Sheng TS Chen Kuang-Hua KH Wu Ren-Chin RC Liu Yu-Jen YJ Cheng Chi-Tung CT Huang Yu-Jen YJ Tao Liang-Wei LW Hwu An-Fong AF Lin I-Chieh IC Hung Shih-Hao SH Yeh Chao-Yuan CY Chen Tse-Ching TC

Nature communications 20220610 1

The pathological identification of lymph node (LN) metastasis is demanding and tedious. Although convolutional neural networks (CNNs) possess considerable potential in improving the process, the ultrahigh-resolution of whole slide images hinders the development of a clinically applicable solution. We design an artificial-intelligence-assisted LN assessment workflow to facilitate the routine counting of metastatic LNs. Unlike previous patch-based approaches, our proposed method trains CNNs by usi ...[more]

PMID: 35688834

Similar Datasets

Project description:BackgroundThe current study aimed to develop a deep learning (DL) model for prediction of lymph node metastasis (LNM) based on hematoxylin and eosin (HE)-stained histopathological images of endometrial cancer (EC). The model was validated using external data.MethodsA total of 2,104 whole slide image (WSI) from 564 patients with pathologically confirmed LNM status were collated from West China Second University Hospital. An artificial intelligence (AI) model was built on the multiple instance-learning (MIL) framework for automatic prediction of the probability of LNM and its performance compared with "Mayo criteria". An additional external data source comprising 533 WSI was collected from two independent medical institutions to validate the model's robustness. Heatmaps were generated to demonstrate regions of the WSI that made the greatest contributions to the DL network output to improve understanding of these processes.ResultsThe proposed MIL model achieved an area under the curve (AUC) of 0.938, a sensitivity of 0.830 and a specificity of 0.911 for LNM prediction to EC. The AUC according to Mayo criteria was 0.666 for the same test dataset. For types I, II and mixed EC, AUCs were 0.927, 0.979 and 0.929, respectively. The predictive performance of the MIL model also achieved an AUC of 0.921 for early staging. In external validation data, the proposed model achieved an AUC of 0.770, a sensitivity of 0.814 and a specificity of 0.520 for LNM prediction. AUCs were 0.783 for type I and 0.818 for early stage EC.ConclusionsThe proposed MIL model generated from histopathological images of EC has a much better LNM predictive performance than that of Mayo criteria. A novel DL-based biomarker trained on different histological subtypes of EC slides was revealed to predict metastatic status with improved accuracy, especially for early staging patients. The current study proves the concept of MIL-based prediction of LNM in EC for the first time, and brought a new sight to improve the accuracy of LNM prediction. Multicenter prospective validation data is required to further confirm the clinical utility.

Project description:ObjectivesPrecise determination of cervical lymph node metastasis (CLNM) involvement in patients with early-stage thyroid cancer is fairly significant for identifying appropriate cervical treatment options. However, it is almost impossible to directly judge lymph node metastasis based on the imaging information of early-stage thyroid cancer patients with clinically negative lymph nodes.MethodsPreoperative US images (BMUS and CDFI) of 1031 clinically node negative PTC patients definitively diagnosed on pathology from two independent hospitals were divided into training set, validation set, internal test set, and external test set. An ensemble deep learning model based on ResNet-50 was built integrating clinical variables, BMUS, and CDFI images using a bagging classifier to predict metastasis of CLN. The final ensemble model performance was compared with expert interpretation.ResultsThe ensemble deep convolutional neural network (DCNN) achieved high performance in predicting CLNM in the test sets examined, with area under the curve values of 0.86 (95% CI 0.78-0.94) for the internal test set and 0.77 (95% CI 0.68-0.87) for the external test set. Compared to all radiologists averaged, the ensemble DCNN model also exhibited improved performance in making predictions. For the external validation set, accuracy was 0.72 versus 0.59 (p = 0.074), sensitivity was 0.75 versus 0.58 (p = 0.039), and specificity was 0.69 versus 0.60 (p = 0.078).ConclusionsDeep learning can non-invasive predict CLNM for clinically node-negative PTC using conventional US imaging of thyroid cancer nodules and clinical variables in a multi-institutional dataset with superior accuracy, sensitivity, and specificity comparable to experts.Critical relevance statementDeep learning efficiently predicts CLNM for clinically node-negative PTC based on US images and clinical variables in an advantageous manner.Key points• A deep learning-based ensemble algorithm for predicting CLNM in PTC was developed. • Ultrasound AI analysis combined with clinical data has advantages in predicting CLNM. • Compared to all experts averaged, the DCNN model achieved higher test performance.

Project description:Lymph node involvement increases the risk of breast cancer recurrence. An accurate non-invasive assessment of nodal involvement is valuable in cancer staging, surgical risk, and cost savings. Radiomics has been proposed to pre-operatively predict sentinel lymph node (SLN) status; however, radiomic models are known to be sensitive to acquisition parameters. The purpose of this study was to develop a prediction model for preoperative prediction of SLN metastasis using deep learning-based (DLB) features and compare its predictive performance to state-of-the-art radiomics. Specifically, this study aimed to compare the generalizability of radiomics vs DLB features in an independent test set with dissimilar resolution. Dynamic contrast-enhancement images from 198 patients (67 positive SLNs) were used in this study. Of these subjects, 163 had an in-plane resolution of 0.7 × 0.7 mm2, which were randomly divided into a training set (approximately 67%) and a validation set (approximately 33%). The remaining 35 subjects with a different in-plane resolution (0.78 × 0.78 mm2) were treated as independent testing set for generalizability. Two methods were employed: (1) conventional radiomics (CR), and (2) DLB features which replaced hand-curated features with pre-trained VGG-16 features. The threshold determined using the training set was applied to the independent validation and testing dataset. Same feature reduction, feature selection, model creation procedures were used for both approaches. In the validation set (same resolution as training), the DLB model outperformed the CR model (accuracy 83% vs 80%). Furthermore, in the independent testing set of the dissimilar resolution, the DLB model performed markedly better than the CR model (accuracy 77% vs 71%). The predictive performance of the DLB model outperformed the CR model for this task. More interestingly, these improvements were seen particularly in the independent testing set of dissimilar resolution. This could indicate that DLB features can ultimately result in a more generalizable model.

Dataset Information

Deep neural network trained on gigapixel images improves lymph node metastasis detection in clinical settings.

Publications

Deep neural network trained on gigapixel images improves lymph node metastasis detection in clinical settings.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets