Monitor science pipelines runs

For the science pipelines that have been converted to the Workflow System, you can easily track the progress of the job you submitted via FRB Web.

Supported Science Pipelines

Currently only the following science pipelines have been converted to run with Workflow:

• Header Localization
• Intensity DM Pipeline
• Intensity Fitburst

Monitoring Work in Buckets

After a Work has been deposited via FRB Web, the button on FRB Web Science Analysis page should take you to the corresponding pipeline in Buckets. From there, select the Work that you have deposited, and you would be able to view the Work specific metrics and logs.

View Work Details

click on the Details toggle to view the Work payload that contains parameters associated with the Work (e.g. tags, products, config).

View Work Logs

click on the Work Id field in the table, which should redirect you to the individual Work page. If the Work status is running, its logs (if any) will be fetched from Loki. If the Work has already finished, there will be a link to the individual Work page in Results, where the logs are available (see Checking Work Results).

Checking Work Results

There is another button, on FRB Web Science Analysis page that redirects you to the corresponding pipeline in Results.

There are two ways to check the results for a specific Work:

1. Staying on the pipeline specific page:
   After identifying the Work from the table, use the three header columns:
   View Work Details : click on the Details toggle to view the Work payload that contains parameters associated with the Work (e.g. tags, products, config).
   View Plots : To view the plots generated by the Work, click on the Plots toggle; all associated plots and their storage paths will then be fetched from site.
   Delete Work Results : To delete any unwanted results from the Workflow Results database, click on the delete button.

2. Go to Individual Work Results page:
   After identifying the Work from the table, right click to Open Link in New Tab to view the individual Work Results page.
   On the individual Work Results page, the Plots are fetched by default; the dark green panel on the left also provides some key metrics related to the Work. To view the logs associated with the specific Work, click on the Work Logs toggle: To view Work Details, click on the Work Details toggle: