Skip to content

Setup/Deployment of Workflow

Steps to setup the workflow

  • MongoDB
  • Buckets
  • Authentication
  • Webpage

Checking the storage using lsblk to decide where to put in the DB. Highly recommended to have sep. DB for Buckets and Results. Buckets is all a single collection: 'buckets', which has all pipelines inside it. Whereas Results is a collection per 'pipeline'.

Setting up the database

  • Go to node with that will host the DB
  • Make the following directories on your disk under mongodb:
  • results
  • buckets
  • chmod -R 777 both of these directories to allow anyone access.
Bash
cd mongodb/
sudo mkdir results
sudo mkdir buckets
sudo chmod -R 777 mongodb/
  • Create the compose file for the MongoDB for buckets, make sure to define a volume in the compose file to bind the local directory.
  • Add service for the results DB as well.
  • Volume example:
YAML
volumes:
  data:
    driver: local
    driver_opts:
      type: none
      device: /path/to/mongodb/buckets
      o: bind
  • Deploy the MongoDB services using the compose file.
  • Databases should not be exposed publicly, it is internal and only the backends connect to it.

Workflow Web

Proxy (Traefik)

Set up your proxy. There's a lot to Traefik to cover here.

Webpage

The webpage needs to have a Traefik configuration so that the container will be routed by Traefik. This can be either with a configuration file or labels in the compose file.