Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Increasing workflow development speed and reproducibility with Vectools.

ABSTRACT: Despite advances in bioinformatics, custom scripts remain a source of difficulty, slowing workflow development and hampering reproducibility. Here, we introduce Vectools, a command-line tool-suite to reduce reliance on custom scripts and improve reproducibility by offering a wide range of common easy-to-use functions for table and vector manipulation. Vectools also offers a number of vector related functions to speed up workflow development, such as simple machine learning and common statistics functions.

SUBMITTER: Weirick T

PROVIDER: S-EPMC6281013 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Increasing workflow development speed and reproducibility with Vectools.

Weirick Tyler T Müller Raphael R Uchida Shizuka S

F1000Research 20180920

Despite advances in bioinformatics, custom scripts remain a source of difficulty, slowing workflow development and hampering reproducibility. Here, we introduce Vectools, a command-line tool-suite to reduce reliance on custom scripts and improve reproducibility by offering a wide range of common easy-to-use functions for table and vector manipulation. Vectools also offers a number of vector related functions to speed up workflow development, such as simple machine learning and common statistics ...[more]

PMID: 30631441

Similar Datasets

Motor Imagery Development in Children: Changes in Speed and Accuracy With Increasing Age.

Project description:Although motor imagery has been pointed as a promising strategy for the rehabilitation of children with neurological disorders, information on their development throughout childhood and adolescence is still scarce. For instance, it is still unclear at what age they reach a development comparable to the motor imagery performance observed in adults. Herein we used a mental rotation task to assess motor imagery in 164 typically developing children and adolescents, which were divided into four age groups (6-7, 8-9, 10-11, and 12-13 years) and 30 adults. The effects of biomechanical constraints, accuracy, and reaction time of the mental rotation task were considered. ANOVA showed that all groups had the effect of biomechanical restrictions of the mental rotation task. We found a group effect for accuracy [F (4, 180) = 17,560; p < 0.00; ?2 = 3.79] and reaction time [F (4, 180) = 17.5; p < 0.001, ?2 = 0.615], with the results of children groups 6-7 and 8-9 years being significantly lower than the other groups (p < 0.05). In all the analyses, there were no differences regarding accuracy and reaction time among the participants of the age groups 10-11 and 12-13 years and adults (p > 0.05). Concluding, children aged 6-7 years were able to perform motor imagery, motor imagery ability improved as the participants' ages increased, and children aged 10 and over-performed similarly to adults.

| S-EPMC7082325 | biostudies-literature

YAMP: a containerized workflow enabling reproducibility in metagenomics research.

Project description:YAMP ("Yet Another Metagenomics Pipeline") is a user-friendly workflow that enables the analysis of whole shotgun metagenomic data while using containerization to ensure computational reproducibility and facilitate collaborative research. YAMP can be executed on any UNIX-like system and offers seamless support for multiple job schedulers as well as for the Amazon AWS cloud. Although YAMP was developed to be ready to use by nonexperts, bioinformaticians will appreciate its flexibility, modularization, and simple customization.

| S-EPMC6047416 | biostudies-literature

Watchdog 2.0: New developments for reusability, reproducibility, and workflow execution.

Project description:Advances in high-throughput methods have brought new challenges for biological data analysis, often requiring many interdependent steps applied to a large number of samples. To address this challenge, workflow management systems, such as Watchdog, have been developed to support scientists in the (semi-)automated execution of large analysis workflows. Here, we present Watchdog 2.0, which implements new developments for module creation, reusability, and documentation and for reproducibility of analyses and workflow execution. Developments include a graphical user interface for semi-automatic module creation from software help pages, sharing repositories for modules and workflows, and a standardized module documentation format. The latter allows generation of a customized reference book of public and user-specific modules. Furthermore, extensive logging of workflow execution, module and software versions, and explicit support for package managers and container virtualization now ensures reproducibility of results. A step-by-step analysis protocol generated from the log file may, e.g., serve as a draft of a manuscript methods section. Finally, 2 new execution modes were implemented. One allows resuming workflow execution after interruption or modification without rerunning successfully executed tasks not affected by changes. The second one allows detaching and reattaching to workflow execution on a local computer while tasks continue running on computer clusters. Watchdog 2.0 provides several new developments that we believe to be of benefit for large-scale bioinformatics analysis and that are not completely covered by other competing workflow management systems. The software itself, module and workflow repositories, and comprehensive documentation are freely available at https://www.bio.ifi.lmu.de/watchdog.

| S-EPMC7298769 | biostudies-literature

A workflow reproducibility scale for automatic validation of biological interpretation results.

Project description:BackgroundReproducibility of data analysis workflow is a key issue in the field of bioinformatics. Recent computing technologies, such as virtualization, have made it possible to reproduce workflow execution with ease. However, the reproducibility of results is not well discussed; that is, there is no standard way to verify whether the biological interpretation of reproduced results is the same. Therefore, it still remains a challenge to automatically evaluate the reproducibility of results.ResultsWe propose a new metric, a reproducibility scale of workflow execution results, to evaluate the reproducibility of results. This metric is based on the idea of evaluating the reproducibility of results using biological feature values (e.g., number of reads, mapping rate, and variant frequency) representing their biological interpretation. We also implemented a prototype system that automatically evaluates the reproducibility of results using the proposed metric. To demonstrate our approach, we conducted an experiment using workflows used by researchers in real research projects and the use cases that are frequently encountered in the field of bioinformatics.ConclusionsOur approach enables automatic evaluation of the reproducibility of results using a fine-grained scale. By introducing our approach, it is possible to evolve from a binary view of whether the results are superficially identical or not to a more graduated view. We believe that our approach will contribute to more informed discussion on reproducibility in bioinformatics.

| S-EPMC10164546 | biostudies-literature

Unifying package managers, workflow engines, and containers: Computational reproducibility with BioNix.

Project description:A challenge for computational biologists is to make our analyses reproducible-i.e. to rerun, combine, and share, with the assurance that equivalent runs will generate identical results. Current best practice aims at this using a combination of package managers, workflow engines, and containers. We present BioNix, a lightweight library built on the Nix deployment system. BioNix manages software dependencies, computational environments, and workflow stages together using a single abstraction: pure functions. This lets users specify workflows in a clean, uniform way, with strong reproducibility guarantees. BioNix is implemented in the Nix expression language and is released on GitHub under the 3-clause BSD license: https://github.com/PapenfussLab/bionix (biotools:BioNix) (BioNix, RRID:SCR_017662).

| S-EPMC7672450 | biostudies-literature

Study of workflow development

Project description:ViralFlow: an automated workflow for SARS-CoV-2 genome assembly, lineage assignment, mutations and intrahost variants detection

| PRJEB47823 | ENA

Scikick: A sidekick for workflow clarity and reproducibility during extensive data analysis.

Project description:Reproducibility is crucial for scientific progress, yet a clear research data analysis workflow is challenging to implement and maintain. As a result, a record of computational steps performed on the data to arrive at the key research findings is often missing. We developed Scikick, a tool that eases the configuration, execution, and presentation of scientific computational analyses. Scikick allows for workflow configurations with notebooks as the units of execution, defines a standard structure for the project, automatically tracks the defined interdependencies between the data analysis steps, and implements methods to compile all research results into a cohesive final report. Utilities provided by Scikick help turn the complicated management of transparent data analysis workflows into a standardized and feasible practice. Scikick version 0.2.1 code and documentation is available as supplementary material. The Scikick software is available on GitHub (https://github.com/matthewcarlucci/scikick) and is distributed with PyPi (https://pypi.org/project/scikick/) under a GPL-3 license.

| S-EPMC10374128 | biostudies-literature

OneD: increasing reproducibility of Hi-C samples with abnormal karyotypes.

Project description:The three-dimensional conformation of genomes is an essential component of their biological activity. The advent of the Hi-C technology enabled an unprecedented progress in our understanding of genome structures. However, Hi-C is subject to systematic biases that can compromise downstream analyses. Several strategies have been proposed to remove those biases, but the issue of abnormal karyotypes received little attention. Many experiments are performed in cancer cell lines, which typically harbor large-scale copy number variations that create visible defects on the raw Hi-C maps. The consequences of these widespread artifacts on the normalized maps are mostly unexplored. We observed that current normalization methods are not robust to the presence of large-scale copy number variations, potentially obscuring biological differences and enhancing batch effects. To address this issue, we developed an alternative approach designed to take into account chromosomal abnormalities. The method, called OneD, increases reproducibility among replicates of Hi-C samples with abnormal karyotype, outperforming previous methods significantly. On normal karyotypes, OneD fared equally well as state-of-the-art methods, making it a safe choice for Hi-C normalization. OneD is fast and scales well in terms of computing resources for resolutions up to 5 kb.

| S-EPMC5934634 | biostudies-literature

Increasing the reproducibility of fluid biomarker studies in neurodegenerative studies.

Project description:Biomarkers have revolutionized scientific research on neurodegenerative diseases, in particular Alzheimer's disease, transformed drug trial design, and are also increasingly improving patient management in clinical practice. A few key cerebrospinal fluid biomarkers have been robustly associated with neurodegenerative diseases. Several novel biomarkers are very promising, especially blood-based markers. However, many biomarker findings have had low reproducibility despite initial promising results. In this perspective, we identify possible sources for low reproducibility of studies on fluid biomarkers for neurodegenerative diseases, with a focus on Alzheimer's disease. We suggest guidelines for researchers and journal editors, with the aim to improve reproducibility of findings.

| S-EPMC7721731 | biostudies-literature

Integrating automated liquid handling in the separation workflow of extracellular vesicles enhances specificity and reproducibility.

Project description:BackgroundExtracellular vesicles (EV) are extensively studied in human body fluids as potential biomarkers for numerous diseases. Major impediments of EV-based biomarker discovery include the specificity and reproducibility of EV sample preparation as well as intensive manual labor. We present an automated liquid handling workstation for the density-based separation of EV from human body fluids and compare its performance to manual handling by (in)experienced researchers.ResultsAutomated versus manual density-based separation of trackable recombinant extracellular vesicles (rEV) spiked in PBS significantly reduces variability in rEV recovery as quantified by fluorescent nanoparticle tracking analysis and ELISA. To validate automated density-based EV separation from complex body fluids, including blood plasma and urine, we assess reproducibility, recovery, and specificity by mass spectrometry-based proteomics and transmission electron microscopy. Method reproducibility is the highest in the automated procedure independent of the matrix used. While retaining (in urine) or enhancing (in plasma) EV recovery compared to manual liquid handling, automation significantly reduces the presence of body fluid specific abundant proteins in EV preparations, including apolipoproteins in plasma and Tamm-Horsfall protein in urine.ConclusionsIn conclusion, automated liquid handling ensures cost-effective EV separation from human body fluids with high reproducibility, specificity, and reduced hands-on time with the potential to enable larger-scale biomarker studies.

| S-EPMC10197845 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data