Experience running Nextflow based pipelines on an on-premise Kubernetes cluster, in production.

0

Entering edit mode

4.8 years ago

s9rao9 • 0

Hello,

Nextflow based workflows are one of the primary contenders for us on our on-premise Kubernetes cluster. We are looking into other options as well. The common denominator being: on-premise Kubernetes cluster for code deployment in production. Can anyone that has relevant experience with running Nextflow workflows on a Kubernetes cluster comment about their takeaways from a stability perspective? Any pros/cons that you think are noteworthy? Is Kubernetes support in Nextflow still in beta?

Your thoughts are much appreciated.

Thanks!

Nextflow Kubernetes Production • 1.8k views

ADD COMMENT • link updated 4.6 years ago by Biostar 20 • written 4.8 years ago by s9rao9 • 0

1

Entering edit mode

I have never used Kubernetes but I have been using Nextflow + Singularity extensively for a while now. I have had no issues with its stability, it has been far more stable than the HPC system that we run it on; almost all of our pipeline failures are attributed to underlying system failures outside the scope of Nextflow.

ADD REPLY • link 4.8 years ago by steve ★ 3.5k

0

Entering edit mode

Thanks for your input, Steve!

ADD REPLY • link 4.8 years ago by s9rao9 • 0

0

Entering edit mode

Also you may want to check the Issues page on GitHub for Kubernettes related listings; https://github.com/nextflow-io/nextflow/issues

Also you can check out the Gitter chatroom; https://gitter.im/nextflow-io/nextflow

ADD REPLY • link 4.8 years ago by steve ★ 3.5k

Login before adding your answer.