Diffusion Flamenco Worker (master) History

History
masterc9dd095288bf5e07d9c6406…

Jan 3 2017

Worker: queued log entries are now protected with a lock.
c9dd095288bf
·Sybren A. Stüvel (sybren) on Jan 3 2017, 10:50 AM.
Worker: some extra logging
52fe0bda31f7
·Sybren A. Stüvel (sybren) on Jan 3 2017, 10:47 AM.
Worker: made register_log() and register_task_update() async funcs
e1971853e29b
·Sybren A. Stüvel (sybren) on Jan 3 2017, 10:47 AM.
Manager: added some comments
05f947231174
·Sybren A. Stüvel (sybren) on Jan 3 2017, 10:36 AM.
Worker: register_log() now supports variable arguments (like logging module)
0896704f228c
·Sybren A. Stüvel (sybren) on Jan 3 2017, 9:23 AM.
Worker: Moved literal constant to a named constant
6ffe9533f453
·Sybren A. Stüvel (sybren) on Jan 3 2017, 9:23 AM.
Worker: master → manager
cecbe7cf8993
·Sybren A. Stüvel (sybren) on Jan 3 2017, 9:22 AM.

Dec 23 2016

Manager: added TODO
bb6506a6dd1b
·Sybren A. Stüvel (sybren) on Dec 23 2016, 5:41 PM.
Manager: Locally apply task status change to our cached version of the task too
7783d9df0c72
·Sybren A. Stüvel (sybren) on Dec 23 2016, 5:41 PM.
Worker: implemented 'exec' command that can run arbitrary CLI commands.
3092c6d94837
·Sybren A. Stüvel (sybren) on Dec 23 2016, 5:29 PM.
Worker: properly handle task updates without changing task status.
64d5b3cdf418
·Sybren A. Stüvel (sybren) on Dec 23 2016, 4:48 PM.
Worker: Add timestamp to log entries.
56fa64ea887b
·Sybren A. Stüvel (sybren) on Dec 23 2016, 4:48 PM.
Manager: store worker remote address when registering.
aa3af967350a
·Sybren A. Stüvel (sybren) on Dec 23 2016, 4:48 PM.
Worker: echo & sleep are working and sending proper status & log to Master
3322cdabae4d
·Sybren A. Stüvel (sybren) on Dec 23 2016, 4:30 PM.
Worker: pushing activity and logs to Master
bd7fc0d75db8
·Sybren A. Stüvel (sybren) on Dec 23 2016, 4:09 PM.
Server: accepting task status/activity/log updates.
3a32141fe0f5
·Sybren A. Stüvel (sybren) on Dec 23 2016, 2:32 PM.
Manager: finished task status/log/activity updates
ccdfc573a3f6
·Sybren A. Stüvel (sybren) on Dec 23 2016, 2:27 PM.
Manager: moved sending of JSON to our own http module.
affa6743dd84
·Sybren A. Stüvel (sybren) on Dec 23 2016, 12:07 PM.
Manager: implemented queued task update pushing to upstream Server
131382dc9a36
·Sybren A. Stüvel (sybren) on Dec 23 2016, 12:00 PM.
Manager: don't error when counting empty collection
f69e8c473e62
·Sybren A. Stüvel (sybren) on Dec 23 2016, 12:00 PM.
Manager: more explicit branch between TLS and non-TLS
e38d64aff874
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:56 AM.
Manager: convert int to time.Duration while loading settings.
d4734939935f
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:53 AM.
Manager: Separated timer functionality from UpstreamConnection
f1de6775cc43
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:40 AM.
Manager: don't omit empty ints, as we should store a zero value too.
3eec88c4d96a
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:18 AM.
Worker: moved scheduling of fetch_task() to startup()
3399843a3cb8
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:13 AM.
Worker: fixed unittest
15a4ae4c3077
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:13 AM.
Turned some relative gitignores into absolutes and vice versa.
8280d78b18c0
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:10 AM.
Stopped gitignoring files that don't exist any more.
763f56ee6d42
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:10 AM.
Removed developer-specific ignores from .gitignore
33178dca5ddf
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:09 AM.

Dec 22 2016

Manager: renamed flamanager.yaml → flamenco-manager.yaml
6232b66350ad
·Sybren A. Stüvel (sybren) on Dec 22 2016, 5:34 PM.
Worker: Started working on task status updates
7c61d3f286ee
·Sybren A. Stüvel (sybren) on Dec 22 2016, 5:32 PM.
Manager: added receiver for task updates
b3dccda9b870
·Sybren A. Stüvel (sybren) on Dec 22 2016, 5:31 PM.
Worker: added some unittests
4af7239e0ce9
·Sybren A. Stüvel (sybren) on Dec 22 2016, 11:33 AM.
Manager: Gracefully handle usernames that are invalid ObjectIDs.
cec3432e4151
·Sybren A. Stüvel (sybren) on Dec 22 2016, 11:33 AM.
Worker: added main loop & task fetching using asyncio loop & scheduler
aee83d6ddc1d
·Sybren A. Stüvel (sybren) on Dec 22 2016, 10:50 AM.
Worker: retrying 5 times in communication with Manager.
83676a534c87
·Sybren A. Stüvel (sybren) on Dec 22 2016, 10:50 AM.
Worker: Moved loading of config to config module.
d7423a958209
·Sybren A. Stüvel (sybren) on Dec 22 2016, 10:50 AM.
Manager: Added supported methods to HTTP router
63e5fc1926ae
·Sybren A. Stüvel (sybren) on Dec 22 2016, 10:50 AM.

Dec 21 2016

Added Python 3.5 Flamenco Worker.
1d4bc7570af7
·Sybren A. Stüvel (sybren) on Dec 21 2016, 6:21 PM.
Separate structs for worker registration & storage.
df4ee7ffaa22
·Sybren A. Stüvel (sybren) on Dec 21 2016, 6:19 PM.
Added TODO
3b7e75c963e2
·Sybren A. Stüvel (sybren) on Dec 21 2016, 4:04 PM.
Added Go (Golang) implementation of Flamenco Manager.
8f0c242bf555
·Sybren A. Stüvel (sybren) on Dec 21 2016, 4:01 PM.
Endpoint for manager startup messages.
b780be6ae9cb
·Sybren A. Stüvel (sybren) on Dec 21 2016, 2:49 PM.
Also filter tasks on manager ID when handing to manager.
fdda2530d3fc
·Sybren A. Stüvel (sybren) on Dec 21 2016, 1:51 PM.
Fixed permission issue creating managers from CLI
b84dc881a033
·Sybren A. Stüvel (sybren) on Dec 21 2016, 1:47 PM.

Dec 20 2016

Also set etag when PATCHing task.
89168baa86dc
·Sybren A. Stüvel (sybren) on Dec 20 2016, 1:40 PM.
Also record modification timestamp when PATCHing
47f67e6c34fe
·Sybren A. Stüvel (sybren) on Dec 20 2016, 1:34 PM.
Removed unused imports
d78e260e17c4
·Sybren A. Stüvel (sybren) on Dec 20 2016, 12:55 PM.
PATCH handler for task status updates
0d776dc824a7
·Sybren A. Stüvel (sybren) on Dec 20 2016, 12:52 PM.
Doc: Space after ## for header
1e2842783dd5
·Sybren A. Stüvel (sybren) on Dec 20 2016, 12:52 PM.

Dec 16 2016

Added access control of Flamenco resources.
23195a736e46
·Sybren A. Stüvel (sybren) on Dec 16 2016, 11:09 AM.

Dec 15 2016

Allow tests to create multiple managers.
b0f99139f143
·Sybren A. Stüvel (sybren) on Dec 15 2016, 5:21 PM.
Added list of projects to manager schema.
0a644c5d689f
·Sybren A. Stüvel (sybren) on Dec 15 2016, 5:21 PM.
Removed ability to embed fields.
0e3631c63b75
·Sybren A. Stüvel (sybren) on Dec 15 2016, 5:04 PM.
One-on-one mapping from service account to manager doc
fba70c099242
·Sybren A. Stüvel (sybren) on Dec 15 2016, 4:53 PM.
Converted blender_simple_render job compiler to AbstractJobCompiler subclass
0d92517bc192
·Sybren A. Stüvel (sybren) on Dec 15 2016, 4:49 PM.
Include project in task schema
2be7169f46a5
·Sybren A. Stüvel (sybren) on Dec 15 2016, 4:48 PM.

Dec 14 2016

Start working on scheduling
dc3ac915a440
·Sybren A. Stüvel (sybren) on Dec 14 2016, 4:03 PM.
Two consecutive frames shouldn't be merged as 'n-m', but 'n,m'
a48153937607
·Sybren A. Stüvel (sybren) on Dec 14 2016, 4:03 PM.
CLI create_manager: print manager info to stdout
0ded73baa3b7
·Sybren A. Stüvel (sybren) on Dec 14 2016, 2:51 PM.
Collections are now named flamenco_xxx instead of flamenco.xxx
1ed7d6d3bd94
·Sybren A. Stüvel (sybren) on Dec 14 2016, 2:40 PM.
renamed job type sleep_simple → sleep
20dd9ac2923b
·Sybren A. Stüvel (sybren) on Dec 14 2016, 2:39 PM.
Added CLI command to create Flamenco managers.
76e159c05972
·Sybren A. Stüvel (sybren) on Dec 14 2016, 2:01 PM.
Added missing link_for_activity -- it's still very dumb.
e9232e0d51d2
·Sybren A. Stüvel (sybren) on Dec 14 2016, 12:12 PM.
Fixed issue when project has no picture_header
b911055b2d80
·Sybren A. Stüvel (sybren) on Dec 14 2016, 12:12 PM.
Removed SVN url
98030c1a4ff8
·Sybren A. Stüvel (sybren) on Dec 14 2016, 12:11 PM.
Reimplemented job compiler & command definitions + lots of other stuff.
6845c36be444
·Sybren A. Stüvel (sybren) on Dec 14 2016, 11:41 AM.
Use isabs(path) instead of path.startswith('/')
0bbeb6d8b4fc
·Sybren A. Stüvel (sybren) on Dec 14 2016, 11:36 AM.
Removed copied & pasted code
2265db85baea
·Sybren A. Stüvel (sybren) on Dec 14 2016, 11:35 AM.
Added useful current_flamenco.db('name') to get Flamenco-specific collection
d9fc4f577752
·Sybren A. Stüvel (sybren) on Dec 14 2016, 11:34 AM.
Explicitly name collections 'flamenco.xxx'
913e78d730ad
·Sybren A. Stüvel (sybren) on Dec 14 2016, 11:34 AM.
Changed manager schema to use dicts for job types and variables.
9e72dc72229f
·Sybren A. Stüvel (sybren) on Dec 14 2016, 11:33 AM.
Removed unused test file
3ab61b295998
·Sybren A. Stüvel (sybren) on Dec 14 2016, 11:24 AM.
gulp script should be executable
766d88e030fc
·Sybren A. Stüvel (sybren) on Dec 14 2016, 11:23 AM.
Ignore cache, and removed trailing stars.
19b3bee6ccd4
·Sybren A. Stüvel (sybren) on Dec 14 2016, 11:23 AM.

Dec 13 2016

Added utils.iter_frame_range to easily iterate frame chunks.
c1d033647a1f
·Sybren A. Stüvel (sybren) on Dec 13 2016, 4:52 PM.

Dec 7 2016

Update managers_schema
4f66d1f16709
·Francesco Siddi (fsiddi) on Dec 7 2016, 1:32 AM.
WIP for test jobs
9a308c91a398
·Francesco Siddi (fsiddi) on Dec 7 2016, 1:32 AM.
Initial manager manager
b41fad860625
·Francesco Siddi (fsiddi) on Dec 7 2016, 1:32 AM.
Update docs
6c0b5eeccc7b
·Francesco Siddi (fsiddi) on Dec 7 2016, 1:32 AM.
Update docs
38da3a6451ec
·Francesco Siddi (fsiddi) on Dec 7 2016, 1:32 AM.

Dec 5 2016

Fix manager "crashing" when no job is available
9ba963a4174a
·Dalai Felinto (dfelinto) on Dec 5 2016, 12:24 AM.

Dec 4 2016

Remove MOCK_SVN_URL and get tests to run again
7fc8b24c78b6
·Francesco Siddi (fsiddi) on Dec 4 2016, 6:42 PM.
Ignore built docs
b23608b7be38
·Francesco Siddi (fsiddi) on Dec 4 2016, 6:42 PM.
Update docs
0949de3db82d
·Francesco Siddi (fsiddi) on Dec 4 2016, 1:53 AM.
Add user to the task schema
0bd1b5e52655
·Francesco Siddi (fsiddi) on Dec 4 2016, 12:32 AM.
Force project param in job schema
d0795479ceaf
·Francesco Siddi (fsiddi) on Dec 4 2016, 12:32 AM.
Add task_for_project function to view project tasks
87116ee8d3d7
·Francesco Siddi (fsiddi) on Dec 4 2016, 12:20 AM.

Dec 3 2016

Fix for rendering of homepage
447a326969f9
·Francesco Siddi (fsiddi) on Dec 3 2016, 11:54 PM.
Add docstring for utils functions
0377f9b87f74
·Francesco Siddi (fsiddi) on Dec 3 2016, 11:33 PM.
Add some comments to managers_schema
1c70b976ae3f
·Francesco Siddi (fsiddi) on Dec 3 2016, 11:29 PM.
Remove unused hooks
f1ea9be587de
·Francesco Siddi (fsiddi) on Dec 3 2016, 11:29 PM.
Remove create jobs
23f41172c48b
·Francesco Siddi (fsiddi) on Dec 3 2016, 11:16 PM.

Dec 2 2016

Addon: descriptions cannot end with "."
b8171fa12b64
·Dalai Felinto (dfelinto) on Dec 2 2016, 4:00 PM.

Dec 1 2016

New statuses
13e7e1e79567
·Pablo Vazquez (pablovazquez) on Dec 1 2016, 12:57 AM.
Fixing broken styles
fe9abce1fd5c
·Pablo Vazquez (pablovazquez) on Dec 1 2016, 12:57 AM.
Job status is not a property
6fcb1e12087e
·Pablo Vazquez (pablovazquez) on Dec 1 2016, 12:57 AM.
Some comments
025fd4895071
·Francesco Siddi (fsiddi) on Dec 1 2016, 12:34 AM.
Take advantage of subcommands
82a8f72dba40
·Francesco Siddi (fsiddi) on Dec 1 2016, 12:34 AM.

Nov 30 2016

Tweaks to navigation
34b9d67963e8
·Francesco Siddi (fsiddi) on Nov 30 2016, 10:45 PM.