Question: Experience running Nextflow based pipelines on an on-premise Kubernetes cluster, in production.
gravatar for s9rao9
12 months ago by
s9rao90 wrote:


Nextflow based workflows are one of the primary contenders for us on our on-premise Kubernetes cluster. We are looking into other options as well. The common denominator being: on-premise Kubernetes cluster for code deployment in production. Can anyone that has relevant experience with running Nextflow workflows on a Kubernetes cluster comment about their takeaways from a stability perspective? Any pros/cons that you think are noteworthy? Is Kubernetes support in Nextflow still in beta?

Your thoughts are much appreciated.


ADD COMMENTlink modified 10 months ago by Biostar ♦♦ 20 • written 12 months ago by s9rao90

I have never used Kubernetes but I have been using Nextflow + Singularity extensively for a while now. I have had no issues with its stability, it has been far more stable than the HPC system that we run it on; almost all of our pipeline failures are attributed to underlying system failures outside the scope of Nextflow.

ADD REPLYlink written 12 months ago by steve2.6k

Thanks for your input, Steve!

ADD REPLYlink written 12 months ago by s9rao90

Also you may want to check the Issues page on GitHub for Kubernettes related listings;

Also you can check out the Gitter chatroom;

ADD REPLYlink written 12 months ago by steve2.6k
Please log in to add an answer.


Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 1649 users visited in the last hour