Question: Is there a good way to test CWL tools and workflows?
gravatar for Carlos Borroto
8 months ago by
Carlos Borroto1.8k
Washington Metropolitan Area
Carlos Borroto1.8k wrote:

I'm getting started writing CWL tools and workflows. I would like to get a good testing framework setup from the beginning. Is there something that can help testing CWL? How are you testing CWL?

I saw cwltest exists. However, the documentation is very sparse. I haven't figured out what should go inside test-descriptions.yml. It is also not clear to me if this tool is just checking for syntax errors, or will it actually try to run a tool or a complete workflow.

Thanks, Carlos

cwl • 636 views
ADD COMMENTlink modified 6 months ago by ionox0280 • written 8 months ago by Carlos Borroto1.8k

cwltest is for the execution of CWL tools and workflows and comparing their outputs with an expected result or an expected failure.

ionox0 comment should be changed to be an answer, as that is basically my response.

ADD REPLYlink written 6 months ago by Michael R. Crusoe1.1k
gravatar for Michael R. Crusoe
6 months ago by
currently based out of Vilnius, Lithuania / Common Workflow Language project
Michael R. Crusoe1.1k wrote: lists tools to assist with CWL composition, including a graphical user interface and plugins for many popular IDEs (Atom, vim, emacs, Visual Studio Code, IntelliJ, gedit). Some of these plugins will do a basic syntax check for you as well.

ADD COMMENTlink written 6 months ago by Michael R. Crusoe1.1k
gravatar for ionox0
6 months ago by
ionox0280 wrote:

Added as answer per @mr-c comment

Some suggestions would be:

  1. Testing with cwltool and the --js-console and --debug options. Also using --tmp-outdir-prefix, -leave-tmpdir, and --leave-outputs to inspect results from intermediate steps

  2. Having small sample inputs that can be used to run the workflows quickly when making changes

  3. Testing the individual tools before the whole workflows

  4. cwltool --validate to only validate the workflow and not run it

  5. cwltool --print-dot and cwltool --print-rdf to show graph of the workflow

ADD COMMENTlink written 6 months ago by ionox0280
Please log in to add an answer.


Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 1243 users visited in the last hour