Spatial Touchstone: A Comprehensive Assessment of Imaging-Based Spatial Transcriptomics, Reproducibility and Best Practices
Ontology highlight
ABSTRACT:
PROVIDER: PRJNA1160328 | ENA |
REPOSITORIES: ENA
Similar Datasets
Project description:Spatial transcriptomics is a rapidly advancing field, yet it lacks standardized metrics for evaluating imaging-based in situ hybridization technologies. In this study, we emphasize the importance of rigorous experimental design and standardized operating procedures (SOPs) in defining performance metrics across multiple modalities—from single-cell to spatial transcriptomics to spatial proteomics. Our Spatial Touchstone (ST) dataset, generated from six tissue types across three global sites (n=76 assays), provides a comprehensive evaluation of reproducibility, sensitivity, dynamic ranges, signal-to-noise ratio, false discovery rates, cell type annotation, and congruence with single-cell profiling. Using single-nucleus RNA sequencing (snRNA-seq) on the same formalin-fixed paraffin-embedded tissues, we created a reference for transcriptional profiles to assess cellular organization and biomarker localization. In the absence of an independent 'gold standard’ in the field, this study provides an objective assessment of technical performance through standardized protocols, Spatial Touchstone Protocols (STSOP). Our open-source software, SpatialQC, allows users to evaluate samples across all technical metrics and directly impute cell annotations from single-cell datasets. This study features the largest imaging-based spatial transcriptomics data repository available, with a total of 203 spatial profiles. It incorporates both public (n=127) and ST datasets (n=76) through the Spatial Touchstone Portal (STP), available at www.spatialtouchstone.org. This resource offers users easy access to analyze and compare their own data against an extensive collection of imaging-based datasets. We show that the ST datasets demonstrate high reproducibility (r=0.93 to 1.0) and set a new benchmark for the field. Finally, we establish metrics to evaluate and integrate imaging based multi omics data from single cell into spatial transcriptomics to spatial proteomics. The ST project provides a comprehensive, reproducible assessment across platforms and sites, establishing essential standards for imaging-based spatial multi omics (transcriptomics and proteomics) and paving the way for future research and technological advancements.
2025-07-28 | GSE277080 | GEO
Project description:The application of toxicogenomics as a predictive tool for chemical risk assessment has been under evaluation by the toxicology community for more than a decade. However, toxicogenomics predominately remains a tool for investigative research rather than for regulatory risk assessment. In this study, we aimed to determine whether the current generation of microarray technology in combination with an in vitro experimental design was capable of generating robust, reproducible data of sufficient quality to show promise as a tool for regulatory risk assessment. To this end, we designed a prospective collaborative study to determine the level of inter- and intra-laboratory reproducibility between three independent laboratories. All test sites adopted the same protocols for all aspects of the toxicogenomic experiment including cell culture, chemical exposure, RNA extraction, microarray data generation and analysis. As a case study, the genotoxic carcinogen B[a]P and the human hepatocyte cell line HepG2 were used to generate three comparable toxicogenomic data sets. High levels of technical reproducibility were demonstrated using a widely employed gene expression microarray platform. While differences at the global transcriptome level were still observed between the test sites, a common subset of B[a]P responsive genes was identified across all test sites which included both genes previously reported in the literature as B[a]P responsive in addition to the same most highly up and down regulated genes. Pending further analysis, these preliminary data show promise that the current generation of microarray technology in combination with a standard in vitro experimental design can produce robust data that can be reproducibly generated in independent laboratories. Future work will need to determine whether in vitro model(s) can be not only reproducible but also predictive for a range of toxic chemicals with different mechanisms of action. Such an approach may potentially be part of future in vitro testing regimes for regulatory risk assessment. The aim of this study was to evaluate the inter- and intra-laboratory reproducibility of toxicogenomics data for toxicity testing in a regulatory setting. 3 Test Centres performed the same experimental protocol treating HepG2 cells with 3 mM Benzo[a]pyrene (B[a]P) (in 0.5% DMSO) for 24 hours prior to RNA extraction and microarray analysis. Three biological replicates of B[a]P and DMSO treatments were analysed by microarray analysis in each Test Centre. Two Test Centres analysed one sample in triplicate to determine technical reproducibility of the chosen array platform. One Centre analysed two samples in duplicate. 24 samples in total were used in this study
2011-12-31 | E-GEOD-25936 | biostudies-arrayexpress
Project description:The purpose of this work was to describe a computational and analytical methodology for profiling small RNA by high-throughput sequencing. The datasets here were used to assess the reproducibility of small RNA datasets produced using Illumina sequencing-by-synthesis technology (SBS). We analyzed the reproducibility of small RNA SBS datasets by comparing libraries generated for biological replicates (rep1 and rep2) and technical replicates (rep2 and rep3).
2009-06-02 | E-GEOD-14694 | biostudies-arrayexpress
Project description:The purpose of this work was to describe a computational and analytical methodology for profiling small RNA by high-throughput sequencing. The datasets here were used to assess the reproducibility of small RNA datasets produced using Illumina sequencing-by-synthesis technology (SBS).
2009-06-03 | GSE14694 | GEO
Project description:The reproducibility of scientific research has been increasingly challenged in recent years. While extrinsic factors (e.g., cross-contamination, mycoplasma infection, serum variability) are well-studied, the role of intrinsic attributes like cell passage number remains underexplored. Using two tumor cell lines (ACHN and Renca), we employed RNA sequencing to analyze transcriptomic dynamics across passages (P3 to P39). Results revealed a nonlinear transcriptomic shift: mid-passage cells (P10/P11, P17) showed heightened activity in cell cycle, metabolism, and stress response, whereas low (P3) and high passages (P24/P39) exhibited stable and similar profiles. KEGG analysis indicated significant alterations in signaling, immune, and metabolic pathways during passaging. This study demonstrates that passage number shapes transcriptional landscapes and impacts experimental reproducibility. We advocate for strict passage control and explicit reporting of passage information to enhance reliability. These findings underscore the need for standardized cell culture practices to improve research reproducibility.
2025-09-24 | GSE308793 | GEO
Project description:The application of toxicogenomics as a predictive tool for chemical risk assessment has been under evaluation by the toxicology community for more than a decade. However, toxicogenomics predominately remains a tool for investigative research rather than for regulatory risk assessment. In this study, we aimed to determine whether the current generation of microarray technology in combination with an in vitro experimental design was capable of generating robust, reproducible data of sufficient quality to show promise as a tool for regulatory risk assessment. To this end, we designed a prospective collaborative study to determine the level of inter- and intra-laboratory reproducibility between three independent laboratories. All test sites adopted the same protocols for all aspects of the toxicogenomic experiment including cell culture, chemical exposure, RNA extraction, microarray data generation and analysis. As a case study, the genotoxic carcinogen B[a]P and the human hepatocyte cell line HepG2 were used to generate three comparable toxicogenomic data sets. High levels of technical reproducibility were demonstrated using a widely employed gene expression microarray platform. While differences at the global transcriptome level were still observed between the test sites, a common subset of B[a]P responsive genes was identified across all test sites which included both genes previously reported in the literature as B[a]P responsive in addition to the same most highly up and down regulated genes. Pending further analysis, these preliminary data show promise that the current generation of microarray technology in combination with a standard in vitro experimental design can produce robust data that can be reproducibly generated in independent laboratories. Future work will need to determine whether in vitro model(s) can be not only reproducible but also predictive for a range of toxic chemicals with different mechanisms of action. Such an approach may potentially be part of future in vitro testing regimes for regulatory risk assessment.
2011-12-31 | GSE25936 | GEO
Project description:Three-dimensional imaging mass spectrometry (3D imaging MS) is a technique of analytical chemistry for 3D molecular analysis of a tissue specimen, entire organ, or microbial colonies on an agar plate. 3D imaging MS has unique advantages over existing 3D imaging techniques, offers novel perspectives for understanding the spatial organization of biological processes, and has growing potential to be introduced into routine use in both biology and medicine. Due to the sheer quantity of data generated, visualization, analysis, and interpretation of 3D imaging MS data remain a significant challenge. Bioinformatics research in this field is hampered by the lack of publicly available benchmark datasets needed for evaluation and comparison of algorithms. Findings We acquired high-quality 3D imaging MS datasets from different biological systems at several labs, supplied them with overview images and scripts demonstrating how to read them, and deposited them into MetaboLights, an open repository for metabolomics data. 3D imaging MS data was collected from five samples using two types of 3D imaging MS. 3D Matrix-Assisted Laser Desorption/Ionization (MALDI) imaging MS data was collected from murine pancreas, murine kidney, human oral squamous cell carcinoma, and interacting microbial colonies cultured in Petri dishes. 3D Desorption Electrospray Ionization (DESI) imaging MS data was collected from a human colorectal adenocarcinoma. Conclusions With the aim to stimulate computational research in the field of computational 3D imaging MS, we provided selected high-quality 3D imaging MS datasets which can be used by algorithm developers as benchmark datasets.
2016-07-27 | MTBLS176 | MetaboLights
Project description:Reproducibility in molecular and cellular studies is fundamental to scientific discovery. To establish the reproducibility of a well-defined long term neuronal differentiation protocol, we repeated the cellular and molecular comparison of the same two iPSC lines across five distinct laboratories. Despite uncovering acceptable variability within individual laboratories, we detect poor cross-site reproducibility of the differential gene expression signature between these two lines. Factor analysis identifies the laboratory as the largest source of variation along with several variation-inflating confounds such as passaging effects and progenitor storage. Single cell transcriptomics shows substantial cellular heterogeneity underlying inter-laboratory variability and being responsible for biases in differential gene expression inference. Factor analysis-based normalization of the combined dataset can remove the nuisance technical effects, enabling the execution of robust hypothesis generating studies. Our study shows that multi-center collaborations can expose systematic biases and identify critical factors to be standardized when publishing novel protocols, contributing to increased cross-site reproducibility.
2018-08-20 | GSE118733 | GEO
Project description:Reproducibility in molecular and cellular studies is fundamental to scientific discovery. To establish the reproducibility of a well-defined long term neuronal differentiation protocol, we repeated the cellular and molecular comparison of the same two iPSC lines across five distinct laboratories. Despite uncovering acceptable variability within individual laboratories, we detect poor cross-site reproducibility of the differential gene expression signature between these two lines. Factor analysis identifies the laboratory as the largest source of variation along with several variation-inflating confounds such as passaging effects and progenitor storage. Single cell transcriptomics shows substantial cellular heterogeneity underlying inter-laboratory variability and being responsible for biases in differential gene expression inference. Factor analysis-based normalization of the combined dataset can remove the nuisance technical effects, enabling the execution of robust hypothesis generating studies. Our study shows that multi-center collaborations can expose systematic biases and identify critical factors to be standardized when publishing novel protocols, contributing to increased cross-site reproducibility.
2018-08-20 | GSE118734 | GEO
Project description:Interactions between RNAs and RNA binding proteins (RBPs) regulate gene expression in eukaryotic cells. RNA-RBP affinities measured in vitro reveal diverse binding specificities, yet approaches to directly compare specificities across RBPs are lacking. Here, we introduce two quantitative metrics: inherent specificity, which measures how selectively an RBP distinguishes its strongest binding motif from all possible motifs, and mutational sensitivity, which assesses tolerance to single nucleotide variations within preferred motifs. Analyzing high-throughput sequencing datasets, we compared these metrics across 100 RBPs in vitro and 27 RBPs in cells, finding strong correlation between in vitro and cellular measurements for RBPs that bind RNA independently of a local structural context. Through CLIP experiments with swapped RNA recognition motifs between a low-specificity RBP (RBM25) and a high-specificity RBP (HNRNPC), we demonstrated that sequence specificity can be transferred between protein contexts. Using these insights, we developed mathematical models showing how RBPs with different specificity profiles compete for binding sites, revealing how variations in inherent specificity and mutational sensitivity influence target selection. Together, our results provide a quantitative framework for modeling RNA-RBP interactions and designing RBPs with targeted specificity.
2025-03-28 | GSE291358 | GEO