Question: (Closed) How to parallel task in bash elegantly?
1
gravatar for wang.yiguan
29 days ago by
wang.yiguan10
wang.yiguan10 wrote:

Are there any elegant way to parallel processing in bash? Something like R packages "parallel" or Python module "multiprocessing"! Thanks!

bash parallel • 136 views
ADD COMMENTlink modified 29 days ago by WouterDeCoster27k • written 29 days ago by wang.yiguan10

Hello wang.yiguan!

Questions similar to yours can already be found at:

We have closed your question to allow us to keep similar content in the same thread.

If you disagree with this please tell us why in a reply below. We'll be happy to talk about it.

Cheers!

PS: many duplicate on biostars.search for gnu parallel, Makefile , snakemake, cwl, xargs ...

ADD REPLYlink modified 29 days ago • written 29 days ago by Pierre Lindenbaum106k
3
gravatar for WouterDeCoster
29 days ago by
Belgium
WouterDeCoster27k wrote:

GNU parallel is a very flexible tool for this, e.g.

ls *.fastq | parallel -j 8 'bwa mem ref.fa {} > {.}.sam'

Use 8 jobs, do alignment for each file in *.fastq, output is input without extension (+ .sam).

ADD COMMENTlink modified 29 days ago • written 29 days ago by WouterDeCoster27k
Please log in to add an answer.
The thread is closed. No new answers may be added.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 945 users visited in the last hour