Question: Try to find a tool for creating a pipeline with PBS scripts?
0
gravatar for longsong
3 days ago by
longsong0
longsong0 wrote:

I have been doing some next-gen data analysis. I often need to do trimming, mapping, calling vcf etc. for genome sequencing data with PBS script on an HPC.

However, it is tedious to submit several jobs manually one by one.

As far as I know, make can not be used with PBS scripts.

What I need is a kind of tool like make, and the tool could be used with PBS scripts. If I have this kind of tool, I could type one command to do the whole data analysis.

Anyone has good suggestions?

Thanks!

make pipeline • 57 views
ADD COMMENTlink modified 3 days ago by h.mon31k • written 3 days ago by longsong0
0
gravatar for h.mon
3 days ago by
h.mon31k
Brazil
h.mon31k wrote:

It is possible to use make with PBS, one just needs some creativity - see gnu-make-job-scheduler. But you probably want a workflow manager such as CWL, Nextflow or Snakemake - there are many others, but I think those are the "most famous".

ADD COMMENTlink written 3 days ago by h.mon31k

I agree with h.mon. I've been using Snakemake, and it's been easy to scale input quantity

ADD REPLYlink written 3 days ago by Robert W. Link0

Thanks!

I'll check these tools.

ADD REPLYlink written 1 day ago by longsong0
Please log in to add an answer.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 2105 users visited in the last hour