Question: Experience running Nextflow based pipelines on an on-premise Kubernetes cluster, in production.
gravatar for s9rao9
6 weeks ago by
s9rao90 wrote:


Nextflow based workflows are one of the primary contenders for us on our on-premise Kubernetes cluster. We are looking into other options as well. The common denominator being: on-premise Kubernetes cluster for code deployment in production. Can anyone that has relevant experience with running Nextflow workflows on a Kubernetes cluster comment about their takeaways from a stability perspective? Any pros/cons that you think are noteworthy? Is Kubernetes support in Nextflow still in beta?

Your thoughts are much appreciated.


ADD COMMENTlink modified 13 days ago by Biostar ♦♦ 20 • written 6 weeks ago by s9rao90

I have never used Kubernetes but I have been using Nextflow + Singularity extensively for a while now. I have had no issues with its stability, it has been far more stable than the HPC system that we run it on; almost all of our pipeline failures are attributed to underlying system failures outside the scope of Nextflow.

ADD REPLYlink written 6 weeks ago by steve2.2k

Thanks for your input, Steve!

ADD REPLYlink written 6 weeks ago by s9rao90

Also you may want to check the Issues page on GitHub for Kubernettes related listings;

Also you can check out the Gitter chatroom;

ADD REPLYlink written 6 weeks ago by steve2.2k
Please log in to add an answer.


Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 1782 users visited in the last hour