Dataset Information

Spatially aware deep learning reveals tumor heterogeneity patterns that encode distinct kidney cancer states.

ABSTRACT: Clear cell renal cell carcinoma (ccRCC) is molecularly heterogeneous, immune infiltrated, and selectively sensitive to immune checkpoint inhibition (ICI). However, the joint tumor-immune states that mediate ICI response remain elusive. We develop spatially aware deep-learning models of tumor and immune features to learn representations of ccRCC tumors using diagnostic whole-slide images (WSIs) in untreated and treated contexts (n = 1,102 patients). We identify patterns of grade heterogeneity in WSIs not achievable through human pathologist analysis, and these graph-based "microheterogeneity" structures associate with PBRM1 loss of function and with patient outcomes. Joint analysis of tumor phenotypes and immune infiltration identifies a subpopulation of highly infiltrated, microheterogeneous tumors responsive to ICI. In paired multiplex immunofluorescence images of ccRCC, microheterogeneity associates with greater PD1 activation in CD8⁺ lymphocytes and increased tumor-immune interactions. Our work reveals spatially interacting tumor-immune structures underlying ccRCC biology that may also inform selective response to ICI.

SUBMITTER: Nyman J

PROVIDER: S-EPMC10518628 | biostudies-literature | 2023 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Spatially aware deep learning reveals tumor heterogeneity patterns that encode distinct kidney cancer states.

Nyman Jackson J Denize Thomas T Bakouny Ziad Z Labaki Chris C Titchen Breanna M BM Bi Kevin K Hari Surya Narayanan SN Rosenthal Jacob J Mehta Nicita N Jiang Bowen B Sharma Bijaya B Felt Kristen K Umeton Renato R Braun David A DA Rodig Scott S Choueiri Toni K TK Signoretti Sabina S Van Allen Eliezer M EM

Cell reports. Medicine 20230901 9

Clear cell renal cell carcinoma (ccRCC) is molecularly heterogeneous, immune infiltrated, and selectively sensitive to immune checkpoint inhibition (ICI). However, the joint tumor-immune states that mediate ICI response remain elusive. We develop spatially aware deep-learning models of tumor and immune features to learn representations of ccRCC tumors using diagnostic whole-slide images (WSIs) in untreated and treated contexts (n = 1,102 patients). We identify patterns of grade heterogeneity in ...[more]

PMID: 37729872

Similar Datasets

Project description:Convolutional neural networks (CNNs) are revolutionizing digital pathology by enabling machine learning-based classification of a variety of phenotypes from hematoxylin and eosin (H&E) whole slide images (WSIs), but the interpretation of CNNs remains difficult. Most studies have considered interpretability in a post hoc fashion, e.g. by presenting example regions with strongly predicted class labels. However, such an approach does not explain the biological features that contribute to correct predictions. To address this problem, here we investigate the interpretability of H&E-derived CNN features (the feature weights in the final layer of a transfer-learning-based architecture). While many studies have incorporated CNN features into predictive models, there has been little empirical study of their properties. We show such features can be construed as abstract morphological genes ("mones") with strong independent associations to biological phenotypes. Many mones are specific to individual cancer types, while others are found in multiple cancers especially from related tissue types. We also observe that mone-mone correlations are strong and robustly preserved across related cancers. Importantly, linear mone-based classifiers can very accurately separate 38 distinct classes (19 tumor types and their adjacent normals, AUC = [Formula: see text] for each class prediction), and linear classifiers are also highly effective for universal tumor detection (AUC = [Formula: see text]). This linearity provides evidence that individual mones or correlated mone clusters may be associated with interpretable histopathological features or other patient characteristics. In particular, the statistical similarity of mones to gene expression values allows integrative mone analysis via expression-based bioinformatics approaches. We observe strong correlations between individual mones and individual gene expression values, notably mones associated with collagen gene expression in ovarian cancer. Mone-expression comparisons also indicate that immunoglobulin expression can be identified using mones in colon adenocarcinoma and that immune activity can be identified across multiple cancer types, and we verify these findings by expert histopathological review. Our work demonstrates that mones provide a morphological H&E decomposition that can be effectively associated with diverse phenotypes, analogous to the interpretability of transcription via gene expression values. Our work also demonstrates mones can be interpreted without using a classifier as a proxy.

Dataset Information

Spatially aware deep learning reveals tumor heterogeneity patterns that encode distinct kidney cancer states.

Publications

Spatially aware deep learning reveals tumor heterogeneity patterns that encode distinct kidney cancer states.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets