Reproducible, interactive, scalable and extensible microbiome data science using QIIME 2.
Ontology highlight
ABSTRACT:
SUBMITTER: Bolyen E
PROVIDER: S-EPMC7015180 | biostudies-literature | 2019 Aug
REPOSITORIES: biostudies-literature
Publications
Reproducible, interactive, scalable and extensible microbiome data science using QIIME 2.
Bolyen Evan E Rideout Jai Ram JR Dillon Matthew R MR Bokulich Nicholas A NA Abnet Christian C CC Al-Ghalith Gabriel A GA Alexander Harriet H Alm Eric J EJ Arumugam Manimozhiyan M Asnicar Francesco F Bai Yang Y Bisanz Jordan E JE Bittinger Kyle K Brejnrod Asker A Brislawn Colin J CJ Brown C Titus CT Callahan Benjamin J BJ Caraballo-Rodríguez Andrés Mauricio AM Chase John J Cope Emily K EK Da Silva Ricardo R Diener Christian C Dorrestein Pieter C PC Douglas Gavin M GM Durall Daniel M DM Duvallet Claire C Edwardson Christian F CF Edwardson Christian F CF Ernst Madeleine M Estaki Mehrbod M Fouquier Jennifer J Gauglitz Julia M JM Gibbons Sean M SM Gibson Deanna L DL Gonzalez Antonio A Gorlick Kestrel K Guo Jiarong J Hillmann Benjamin B Holmes Susan S Holste Hannes H Huttenhower Curtis C Huttley Gavin A GA Janssen Stefan S Jarmusch Alan K AK Jiang Lingjing L Kaehler Benjamin D BD Kang Kyo Bin KB Keefe Christopher R CR Keim Paul P Kelley Scott T ST Knights Dan D Koester Irina I Kosciolek Tomasz T Kreps Jorden J Langille Morgan G I MGI Lee Joslynn J Ley Ruth R Liu Yong-Xin YX Loftfield Erikka E Lozupone Catherine C Maher Massoud M Marotz Clarisse C Martin Bryan D BD McDonald Daniel D McIver Lauren J LJ Melnik Alexey V AV Metcalf Jessica L JL Morgan Sydney C SC Morton Jamie T JT Naimey Ahmad Turan AT Navas-Molina Jose A JA Nothias Louis Felix LF Orchanian Stephanie B SB Pearson Talima T Peoples Samuel L SL Petras Daniel D Preuss Mary Lai ML Pruesse Elmar E Rasmussen Lasse Buur LB Rivers Adam A Robeson Michael S MS Rosenthal Patrick P Segata Nicola N Shaffer Michael M Shiffer Arron A Sinha Rashmi R Song Se Jin SJ Spear John R JR Swafford Austin D AD Thompson Luke R LR Torres Pedro J PJ Trinh Pauline P Tripathi Anupriya A Turnbaugh Peter J PJ Ul-Hasan Sabah S van der Hooft Justin J J JJJ Vargas Fernando F Vázquez-Baeza Yoshiki Y Vogtmann Emily E von Hippel Max M Walters William W Wan Yunhu Y Wang Mingxun M Warren Jonathan J Weber Kyle C KC Williamson Charles H D CHD Willis Amy D AD Xu Zhenjiang Zech ZZ Zaneveld Jesse R JR Zhang Yilong Y Zhu Qiyun Q Knight Rob R Caporaso J Gregory JG
Nature biotechnology 20190801 8
Similar Datasets
Project description:Metagenome sequencing has revolutionized functional microbiome analysis across diverse ecosystems, but is fraught with technical hurdles. We introduce MOSHPIT (https://moshpit.readthedocs.io), software built on the QIIME 2 framework (Q2F) that integrates best-in-class CAMI2-validated metagenome tools with robust provenance tracking and multiple user interfaces, enabling streamlined, reproducible metagenome analysis for all expertise levels. By building on Q2F, MOSHPIT enhances scalability, interoperability, and reproducibility in complex workflows, democratizing and accelerating discovery at the frontiers of metagenomics.
| S-EPMC11838374 | biostudies-literature
Project description:Backgroundthe analysis of microbial communities through dna sequencing brings many challenges: the integration of different types of data with methods from ecology, genetics, phylogenetics, multivariate statistics, visualization and testing. With the increased breadth of experimental designs now being pursued, project-specific statistical analyses are often needed, and these analyses are often difficult (or impossible) for peer researchers to independently reproduce. The vast majority of the requisite tools for performing these analyses reproducibly are already implemented in R and its extensions (packages), but with limited support for high throughput microbiome census data.ResultsHere we describe a software project, phyloseq, dedicated to the object-oriented representation and analysis of microbiome census data in R. It supports importing data from a variety of common formats, as well as many analysis techniques. These include calibration, filtering, subsetting, agglomeration, multi-table comparisons, diversity analysis, parallelized Fast UniFrac, ordination methods, and production of publication-quality graphics; all in a manner that is easy to document, share, and modify. We show how to apply functions from other R packages to phyloseq-represented data, illustrating the availability of a large number of open source analysis techniques. We discuss the use of phyloseq with tools for reproducible research, a practice common in other fields but still rare in the analysis of highly parallel microbiome census data. We have made available all of the materials necessary to completely reproduce the analysis and figures included in this article, an example of best practices for reproducible research.ConclusionsThe phyloseq project for R is a new open-source software package, freely available on the web from both GitHub and Bioconductor.
| S-EPMC3632530 | biostudies-literature
Project description:High-throughput DNA sequencing technologies, coupled with advanced bioinformatics tools, have enabled rapid advances in microbial ecology and our understanding of the human microbiome. QIIME (Quantitative Insights Into Microbial Ecology) is an open-source bioinformatics software package designed for microbial community analysis based on DNA sequence data, which provides a single analysis framework for analysis of raw sequence data through publication-quality statistical analyses and interactive visualizations. In this chapter, we demonstrate the use of the QIIME pipeline to analyze microbial communities obtained from several sites on the bodies of transgenic and wild-type mice, as assessed using 16S rRNA gene sequences generated on the Illumina MiSeq platform. We present our recommended pipeline for performing microbial community analysis and provide guidelines for making critical choices in the process. We present examples of some of the types of analyses that are enabled by QIIME and discuss how other tools, such as phyloseq and R, can be applied to expand upon these analyses.
| S-EPMC4517945 | biostudies-literature
Project description:Transparent and FAIR disclosure of meta-information about healthcare data and infrastructure is essential but has not been well publicized. In this paper, we provide a transparent disclosure of the process of standardizing a common data model and developing a national data infrastructure using national claims data. We established an Observational Medical Outcome Partnership (OMOP) common data model database for national claims data of the Health Insurance Review and Assessment Service of South Korea. To introduce a data openness policy, we built a distributed data analysis environment and released metadata based on the FAIR principle. A total of 10,098,730,241 claims and 56,579,726 patients' data were converted as OMOP common data model. We also built an analytics environment for distributed research and made the metadata publicly available. Disclosure of this infrastructure to researchers will help to eliminate information inequality and contribute to the generation of high-quality medical evidence.
| S-EPMC10550904 | biostudies-literature
Project description:MotivationWhile the workflow for primary analysis of single-cell RNA-seq (scRNA-seq) data is well established, the secondary analysis of the feature-barcode matrix is usually done by custom scripts. There is no fully automated pipeline in the R statistical environment, which would follow the current best programming practices and requirements for reproducibility.ResultsWe have developed scdrake, a fully automated workflow for secondary analysis of scRNA-seq data, which is fully implemented in the R language and built within the drake framework. The pipeline includes quality control, cell and gene filtering, normalization, detection of highly variable genes, dimensionality reduction, clustering, cell type annotation, detection of marker genes, differential expression analysis and integration of multiple samples. The pipeline is reproducible and scalable, has an efficient execution, provides easy extendability and access to intermediate results and outputs rich HTML reports. Scdrake is distributed as a Docker image, which provides a straightforward setup and enhances reproducibility.Availability and implementationThe source code and documentation are available under the MIT license at https://github.com/bioinfocz/scdrake and https://bioinfocz.github.io/scdrake, respectively.Supplementary informationSupplementary data are available at Bioinformatics Advances online.
| S-EPMC10351969 | biostudies-literature
Project description:In the rapidly evolving field of bioimaging, the integration and orchestration of findable, accessible, interoperable, and reusable (FAIR) image analysis workflows remains a challenge. We introduce BIOMERO (bioimage analysis in OMERO), a bridge connecting OMERO, a renowned bioimaging data management platform; FAIR workflows; and high-performance computing (HPC) environments. BIOMERO facilitates seamless execution of FAIR workflows, particularly for large datasets from high-content or high-throughput screening. BIOMERO empowers researchers by eliminating the need for specialized knowledge, enabling scalable image processing directly from OMERO. BIOMERO notably supports the sharing and utilization of FAIR workflows between OMERO, Cytomine/BIAFLOWS, and other bioimaging communities. BIOMERO will promote the widespread adoption of FAIR workflows, emphasizing reusability, across the realm of bioimaging research. Its user-friendly interface will empower users, including those without technical expertise, to seamlessly apply these workflows to their datasets, democratizing the utilization of AI by the broader research community.
| S-EPMC11368678 | biostudies-literature
Project description:Big biomedical data create exciting opportunities for discovery, but make it difficult to capture analyses and outputs in forms that are findable, accessible, interoperable, and reusable (FAIR). In response, we describe tools that make it easy to capture, and assign identifiers to, data and code throughout the data lifecycle. We illustrate the use of these tools via a case study involving a multi-step analysis that creates an atlas of putative transcription factor binding sites from terabytes of ENCODE DNase I hypersensitive sites sequencing data. We show how the tools automate routine but complex tasks, capture analysis algorithms in understandable and reusable forms, and harness fast networks and powerful cloud computers to process data rapidly, all without sacrificing usability or reproducibility-thus ensuring that big data are not hard-to-(re)use data. We evaluate our approach via a user study, and show that 91% of participants were able to replicate a complex analysis involving considerable data volumes.
| S-EPMC6459504 | biostudies-literature
Project description:Objective:Bioinformatics publications typically include complex software workflows that are difficult to describe in a manuscript. We describe and demonstrate the use of interactive software notebooks to document and distribute bioinformatics research. We provide a user-friendly tool, BiocImageBuilder, that allows users to easily distribute their bioinformatics protocols through interactive notebooks uploaded to either a GitHub repository or a private server. Materials and methods:We present four different interactive Jupyter notebooks using R and Bioconductor workflows to infer differential gene expression, analyze cross-platform datasets, process RNA-seq data and KinomeScan data. These interactive notebooks are available on GitHub. The analytical results can be viewed in a browser. Most importantly, the software contents can be executed and modified. This is accomplished using Binder, which runs the notebook inside software containers, thus avoiding the need to install any software and ensuring reproducibility. All the notebooks were produced using custom files generated by BiocImageBuilder. Results:BiocImageBuilder facilitates the publication of workflows with a point-and-click user interface. We demonstrate that interactive notebooks can be used to disseminate a wide range of bioinformatics analyses. The use of software containers to mirror the original software environment ensures reproducibility of results. Parameters and code can be dynamically modified, allowing for robust verification of published results and encouraging rapid adoption of new methods. Conclusion:Given the increasing complexity of bioinformatics workflows, we anticipate that these interactive software notebooks will become as necessary for documenting software methods as traditional laboratory notebooks have been for documenting bench protocols, and as ubiquitous.
| S-EPMC6381817 | biostudies-literature
Project description:Identifying predictive biomarkers of patient outcomes from high-throughput microbiome data is of high interest, while existing computational methods do not satisfactorily account for complex survival endpoints, longitudinal samples, and taxa-specific sequencing biases. We present FLORAL (https://vdblab.github.io/FLORAL/), an open-source computational tool to perform scalable log-ratio lasso regression and microbial feature selection for continuous, binary, time-to-event, and competing risk outcomes, with compatibility of longitudinal microbiome data as time-dependent covariates. The proposed method adapts the augmented Lagrangian algorithm for a zero-sum constraint optimization problem while enabling a two-stage screening process for extended false-positive control. In extensive simulation and real-data analyses, FLORAL achieved consistently better false-positive control compared to other lasso-based approaches, and better sensitivity over popular differential abundance testing methods for datasets with smaller sample size. In a survival analysis in allogeneic hematopoietic-cell transplant, we further demonstrated considerable improvement by FLORAL in microbial feature selection by utilizing longitudinal microbiome data over only using baseline microbiome data.
| S-EPMC10187229 | biostudies-literature
Project description:The emergence of megascale single-cell multiplex tissue imaging (MTI) datasets necessitates reproducible, scalable, and robust tools for cell phenotyping and spatial analysis. We developed open-source, graphics processing unit (GPU)-accelerated tools for intensity normalization, phenotyping, and microenvironment characterization. We deploy the toolkit on a human breast cancer (BC) tissue microarray stained by cyclic immunofluorescence and present the first cross-validation of breast cancer cell phenotypes derived by using two different MTI platforms. Finally, we demonstrate an integrative phenotypic and spatial analysis revealing BC subtype-specific features.
| S-EPMC8415641 | biostudies-literature