Question: possible to show job names in toil stats command using cwl workflow
0
gravatar for ionox0
2.3 years ago by
ionox0360
ionox0360 wrote:

I'm using toil 3.15.0 with a cwl workflow, and I was wondering if there was a way to have the toil stats command list the names of the jobs in the workflow, when my jobs are defined in CWL.

Right now the output shows job names as one of "ResolveIndirect", "CWLGather" ,"CWLWorkflow", "CWLScatter", "CWLJob"

Worker
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
      963 |     0.00    0.66    4.57  497.40 4402.72 |     0.00    0.48    3.84  299.96 3701.92 |   -78.15    0.16    0.73  197.45  700.81 |      48K    151K    232K   7161K 223620K
Job
 Worker Jobs  |     min    med    ave    max
              |     616    616    616    616
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
      616 |     0.04    0.55    6.14  480.00 3780.53 |     0.01    0.26    5.41  298.77 3332.68 |   -79.96    0.26    0.73  181.23  447.85 |     136K    190K    379K   7161K 233935K
 ResolveIndirect
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
      113 |     0.04    0.06    0.07    0.43    7.86 |     0.01    0.02    0.02    0.10    2.11 |     0.03    0.04    0.05    0.34    5.75 |     187K    195K    195K    203K  22048K
 CWLGather
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
       28 |     0.05    0.06    0.10    0.72    2.78 |     0.01    0.02    0.02    0.04    0.55 |     0.03    0.05    0.08    0.70    2.23 |     188K    197K    196K    202K   5499K
 CWLWorkflow
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
      113 |     0.10    0.42    0.46    2.31   52.18 |     0.04    0.14    0.16    1.04   18.07 |     0.05    0.28    0.30    1.27   34.12 |     190K    198K    197K    230K  22334K
 CWLScatter
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
       28 |     0.15    0.66    0.60    1.01   16.90 |     0.05    0.26    0.25    0.54    7.01 |     0.08    0.34    0.35    0.73    9.89 |     189K    197K    196K    201K   5490K
 CWLJob
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
      334 |     0.12    1.85   11.08  480.00 3700.81 |     0.03    0.89    9.90  298.77 3304.95 |   -79.96    0.39    1.19  181.23  395.86 |     136K    141K    534K   7161K 178562K
cwl toil • 486 views
ADD COMMENTlink modified 2.3 years ago by Michael R. Crusoe1.8k • written 2.3 years ago by ionox0360
1

I believe that this is a limitation specific to using CWL with toil

I have a PR here to address this:

https://github.com/DataBiosphere/toil/pull/2397

ADD REPLYlink written 2.3 years ago by ionox0360
2
gravatar for Michael R. Crusoe
2.3 years ago by
Common Workflow Language project
Michael R. Crusoe1.8k wrote:

Thank you ionox0, your PR to Toil to fix this has been merged: https://github.com/DataBiosphere/toil/pull/2397

ADD COMMENTlink written 2.3 years ago by Michael R. Crusoe1.8k
Please log in to add an answer.

Help
Access

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.
Powered by Biostar version 2.3.0
Traffic: 963 users visited in the last hour
_