Question: Is there a good way to test CWL tools and workflows?
3
gravatar for Carlos Borroto
12 months ago by
Carlos Borroto1.8k
Washington Metropolitan Area
Carlos Borroto1.8k wrote:

I'm getting started writing CWL tools and workflows. I would like to get a good testing framework setup from the beginning. Is there something that can help testing CWL? How are you testing CWL?

I saw cwltest exists. However, the documentation is very sparse. I haven't figured out what should go inside test-descriptions.yml. It is also not clear to me if this tool is just checking for syntax errors, or will it actually try to run a tool or a complete workflow.

Thanks, Carlos

cwl • 891 views
ADD COMMENTlink modified 10 months ago by ionox0330 • written 12 months ago by Carlos Borroto1.8k

cwltest is for the execution of CWL tools and workflows and comparing their outputs with an expected result or an expected failure.

ionox0 comment should be changed to be an answer, as that is basically my response.

ADD REPLYlink written 11 months ago by Michael R. Crusoe1.4k
1
gravatar for Michael R. Crusoe
11 months ago by
Common Workflow Language project
Michael R. Crusoe1.4k wrote:

https://www.commonwl.org/#Editors_and_viewers lists tools to assist with CWL composition, including a graphical user interface and plugins for many popular IDEs (Atom, vim, emacs, Visual Studio Code, IntelliJ, gedit). Some of these plugins will do a basic syntax check for you as well.

ADD COMMENTlink written 11 months ago by Michael R. Crusoe1.4k
1
gravatar for ionox0
10 months ago by
ionox0330
ionox0330 wrote:

Added as answer per @mr-c comment

Some suggestions would be:

  1. Testing with cwltool and the --js-console and --debug options. Also using --tmp-outdir-prefix, -leave-tmpdir, and --leave-outputs to inspect results from intermediate steps

  2. Having small sample inputs that can be used to run the workflows quickly when making changes

  3. Testing the individual tools before the whole workflows

  4. cwltool --validate to only validate the workflow and not run it

  5. cwltool --print-dot and cwltool --print-rdf to show graph of the workflow

ADD COMMENTlink written 10 months ago by ionox0330
Please log in to add an answer.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 1629 users visited in the last hour