Impact of concurrency on the performance of a whole exome sequencing pipeline.

ABSTRACT:

Background

Current high-throughput technologies-i.e. whole genome sequencing, RNA-Seq, ChIP-Seq, etc.-generate huge amounts of data and their usage gets more widespread with each passing year. Complex analysis pipelines involving several computationally-intensive steps have to be applied on an increasing number of samples. Workflow management systems allow parallelization and a more efficient usage of computational power. Nevertheless, this mostly happens by assigning the available cores to a single or few samples' pipeline at a time. We refer to this approach as naive parallel strategy (NPS). Here, we discuss an alternative approach, which we refer to as concurrent execution strategy (CES), which equally distributes the available processors across every sample's pipeline.

Resul

SUBMITTER: Dall'Olio D 

PROVIDER: S-EPMC7874478 | biostudies-literature | 2021 Feb

REPOSITORIES: biostudies-literature