Question: Experience running Nextflow based pipelines on an on-premise Kubernetes cluster, in production.
0
gravatar for s9rao9
6 weeks ago by
s9rao90
s9rao90 wrote:

Hello,

Nextflow based workflows are one of the primary contenders for us on our on-premise Kubernetes cluster. We are looking into other options as well. The common denominator being: on-premise Kubernetes cluster for code deployment in production. Can anyone that has relevant experience with running Nextflow workflows on a Kubernetes cluster comment about their takeaways from a stability perspective? Any pros/cons that you think are noteworthy? Is Kubernetes support in Nextflow still in beta?

Your thoughts are much appreciated.

Thanks!

ADD COMMENTlink modified 13 days ago by Biostar ♦♦ 20 • written 6 weeks ago by s9rao90
1

I have never used Kubernetes but I have been using Nextflow + Singularity extensively for a while now. I have had no issues with its stability, it has been far more stable than the HPC system that we run it on; almost all of our pipeline failures are attributed to underlying system failures outside the scope of Nextflow.

ADD REPLYlink written 6 weeks ago by steve2.2k

Thanks for your input, Steve!

ADD REPLYlink written 6 weeks ago by s9rao90

Also you may want to check the Issues page on GitHub for Kubernettes related listings; https://github.com/nextflow-io/nextflow/issues

Also you can check out the Gitter chatroom; https://gitter.im/nextflow-io/nextflow

ADD REPLYlink written 6 weeks ago by steve2.2k
Please log in to add an answer.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 1782 users visited in the last hour