Unknown

Dataset Information

Design considerations for workflow management systems use in production genomics research and the clinic.


ABSTRACT: The changing landscape of genomics research and clinical practice has created a need for computational pipelines capable of efficiently orchestrating complex analysis stages while handling large volumes of data across heterogeneous computational environments. Workflow Management Systems (WfMSs) are the software components employed to fill this gap. This work provides an approach and systematic evaluation of key features of popular bioinformatics WfMSs in use today: Nextflow, CWL, and WDL and some of their executors, along with Swift/T, a workflow manager commonly used in high-scale physics applications. We employed two use cases: a variant-calling genomic pipeline and a scalability-testing framework, where both were run locally, on an HPC cluster, and in the cloud. This allowed for evaluat

SUBMITTER: Ahmed AE 

PROVIDER: S-EPMC8569008 | biostudies-literature | 2021 Nov

REPOSITORIES: biostudies-literature