Skip to content

Workers API

CADC Certs

Update cadc certificate.

main

Python
main()

Update cadc certificate at CHIME and canfar.

Deleter

Deletion worker.

main

Python
main(delete_from)

Main function.

Parameters:

Name Type Description Default
delete_from str

Site name that deleter is running at.

required

perform_deletion

Python
perform_deletion(work, delete_from, test_mode=False)

Perform deletion from work.

Processed Data Fetcher

Processed data fetcher.

fetch_processed_data

Python
fetch_processed_data()

Fetch processed data from arc.

Replication Healer

Replication healer.

heal_staged_file_replicas

Python
heal_staged_file_replicas(target_storage_element, replica_paths, replica_ids, datasets, scopes)

Heal file replicas left as staged.

Replicator

Replication worker.

get_destination

Python
get_destination(file_path, storage_name, replicate_to)

Get the destination file path or uri to push the file to.

main

Python
main(replicate_from, replicate_to)

Main function.

Parameters:

Name Type Description Default
replicate_from str

storage element from where to replocicate data.

required
replicate_to str

storage element where to replocicate data.

required

perform_replication

Python
perform_replication(work, b, test_mode=False)

Perform the replication.

update_work_status

Python
update_work_status(replica_id, transformation, status, storage_element, file_path, md5sum, dataset_name, dataset_scope, storage_element_captured_at)

Update the status of work.