This is the Flamenco Server component, implemented as a Pillar extension.
In order to get Flamenco up and running, we need to follow these steps:
- add Flamenco as Pillar extension to our project
- create a Manager doc
- give a user 'admin' rights for Flamenco (this is temporary)
- give setup a project to use Flamenco
Add Flamenco to your Pillar application as an extension (docs will be available in the Pillar documentaiton). At this point we can proceed with the setup of our first manager.
python manage.py flamenco create_manager email@example.com local-manager 'Local manager'
The required params are:
- firstname.lastname@example.org is a new Pillar service account that gets associated with the
new manager created
- local-manager is the name of the manager
- 'Local manager is a description of the manager
Once the manager doc is created, we note down the following info:
- _id in the new manager doc
- the *Access Token*
We will use these values in the flamenco-manager.yaml config file for the Manager.
Next, we allow a user to interact with a Flamenco project:
python manage.py make_admin email@example.com
where firstname.lastname@example.org is an existing user.
Finally, we set up a project to be used with Flamenco:
python manage.py setup_for_flamenco project-url
At this point we can run our server and access Flamenco on the /flamenco endpoint.
- When a certain percentage of a job's tasks have failed, cancel the remaining tasks and only then mark the job as failed.
- Handle parent relations between tasks (scheduling, canceling, failing etc.)