Diffusion Flamenco Worker (master) History

flamenco-worker/packages
master15d9595a2756fe0fa888390…

Jan 12 2017

Server: added blender_render.py to create render jobs
15d9595a2756
·Sybren A. Stüvel (sybren) on Jan 12 2017, 11:30 AM.

Jan 11 2017

Worker: added TODO to readme
69c87273a1d5
·Sybren A. Stüvel (sybren) on Jan 11 2017, 1:35 PM.
Manager: more thorough handling of cancel-requested task status
7c67d6a97c0a
·Sybren A. Stüvel (sybren) on Jan 11 2017, 1:35 PM.
Server: job status 'cancel-requested' + update job after task status change
27c4eed4e465
·Sybren A. Stüvel (sybren) on Jan 11 2017, 1:35 PM.
Server: fixed unittest
3073789c7c3a
·Sybren A. Stüvel (sybren) on Jan 11 2017, 1:35 PM.
Server: moved some task/job status set/assert code to AbstractFlamencoTest
97e059d87a02
·Sybren A. Stüvel (sybren) on Jan 11 2017, 1:35 PM.

Jan 10 2017

Server: some small fixes to get the blender-render command working
d83c6ba0d2a3
·Sybren A. Stüvel (sybren) on Jan 10 2017, 5:40 PM.
Server: schedule tasks by priority
28b123733312
·Sybren A. Stüvel (sybren) on Jan 10 2017, 4:07 PM.
Server: added role 'flamenco-admin' + CLI cmds to grant/revoke
9d7a8ad8e117
·Sybren A. Stüvel (sybren) on Jan 10 2017, 3:53 PM.
Manager: added TODO
26e2bb10882a
·Sybren A. Stüvel (sybren) on Jan 10 2017, 3:34 PM.
Worker: only log outgoing JSON if there is any.
5a59166e190a
·Sybren A. Stüvel (sybren) on Jan 10 2017, 3:07 PM.
Worker: changed command identifier
cd8043f91a8b
·Sybren A. Stüvel (sybren) on Jan 10 2017, 3:07 PM.
Worker: added may-I-run loop, aborting the current task if the answer is no
9a1ce50af286
·Sybren A. Stüvel (sybren) on Jan 10 2017, 3:05 PM.
Manager: ensure that cancel-requested tasks do not transition to active
cc4f77c97982
·Sybren A. Stüvel (sybren) on Jan 10 2017, 3:00 PM.
Server: ensure that cancel-requested tasks do not transition to active
3ccc9b580dfa
·Sybren A. Stüvel (sybren) on Jan 10 2017, 2:59 PM.
Manager: receive a list of tasks to cancel from the Server
b5ec5ec73f59
·Sybren A. Stüvel (sybren) on Jan 10 2017, 12:04 PM.
Manager: fixed bug in unittest
b70cb12e5200
·Sybren A. Stüvel (sybren) on Jan 10 2017, 12:03 PM.
Server: Added task status 'cancel-requested'
ed0420e9cdcb
·Sybren A. Stüvel (sybren) on Jan 10 2017, 12:00 PM.
Manager: documented communication between server and manager
1ee01fca4fcb
·Sybren A. Stüvel (sybren) on Jan 10 2017, 11:36 AM.
Manager: moved some common test code to gocheck_test.go
7fbd44372d9d
·Sybren A. Stüvel (sybren) on Jan 10 2017, 11:35 AM.
Manager: moved gocheck integration to separate file.
d6f2826c925f
·Sybren A. Stüvel (sybren) on Jan 10 2017, 10:51 AM.

Jan 6 2017

Manager: Added endpoint /may-i-run/{task-id} so Workers can check status
86bc5c73f46e
·Sybren A. Stüvel (sybren) on Jan 6 2017, 4:49 PM.
Manager: use etag to re-fetch queued task before handing it to Worker
ba3276349a7b
·Sybren A. Stüvel (sybren) on Jan 6 2017, 4:01 PM.
Server: allow managers to re-fetch their own tasks.
344b071c1fdc
·Sybren A. Stüvel (sybren) on Jan 6 2017, 3:59 PM.
Manager: re-fetch task from Server before handing it to worker
983e78b28178
·Sybren A. Stüvel (sybren) on Jan 6 2017, 2:55 PM.
Manager: prevent asking scheduler for 0 tasks
375968678194
·Sybren A. Stüvel (sybren) on Jan 6 2017, 1:54 PM.
Manager: a running task should go to state 'active', not 'processing'
6a86c2ad6dce
·Sybren A. Stüvel (sybren) on Jan 6 2017, 1:54 PM.
Manager: allow Timer to do both sleep-ping and ping-sleep
0e19a20582aa
·Sybren A. Stüvel (sybren) on Jan 6 2017, 1:54 PM.
Manager: Configuring logging to show the file from which was logged
584c765cf260
·Sybren A. Stüvel (sybren) on Jan 6 2017, 1:53 PM.
Worker: added some documentation
c441803bed78
·Sybren A. Stüvel (sybren) on Jan 6 2017, 11:18 AM.
Worker: more explicit shutdown of what's currently running upon Ctrl+C
1d32c6a0fd9d
·Sybren A. Stüvel (sybren) on Jan 6 2017, 11:17 AM.
Worker: report on asyncio tasks when shutting down.
80a26aa49444
·Sybren A. Stüvel (sybren) on Jan 6 2017, 11:17 AM.
Worker: PEP8 formatting
013b11989424
·Sybren A. Stüvel (sybren) on Jan 6 2017, 10:42 AM.
Worker: cleaner shutdown on Ctrl+C
fb9c177f9271
·Sybren A. Stüvel (sybren) on Jan 6 2017, 10:42 AM.

Jan 5 2017

Server: Changes in the job status also affect the job's task statuses.
0830a457a129
·Sybren A. Stüvel (sybren) on Jan 5 2017, 5:45 PM.
Server: tweaked blender-render job compiler
066208604ccd
·Sybren A. Stüvel (sybren) on Jan 5 2017, 5:42 PM.
Server: removed task status 'processing'
e5fc8c527a04
·Sybren A. Stüvel (sybren) on Jan 5 2017, 5:41 PM.
Server: update job status based on change in task status.
d09bb1228fe5
·Sybren A. Stüvel (sybren) on Jan 5 2017, 3:59 PM.
Server: added FlamencoExtension.update_status()
70041585a543
·Sybren A. Stüvel (sybren) on Jan 5 2017, 3:58 PM.
Server: typo in comment
b440b86257d1
·Sybren A. Stüvel (sybren) on Jan 5 2017, 3:55 PM.
Manager: fixed unittests
318046952a84
·Sybren A. Stüvel (sybren) on Jan 5 2017, 1:52 PM.

Jan 4 2017

Worker: push updates to manager before shutting down
20b9cf289490
·Sybren A. Stüvel (sybren) on Jan 4 2017, 6:08 PM.
Worker: set last_log_push and last_activity_push to now() using factory
c813ed28b6fb
·Sybren A. Stüvel (sybren) on Jan 4 2017, 6:07 PM.
Worker: better asyncio loop management in unit tests
4e98b8fec08c
·Sybren A. Stüvel (sybren) on Jan 4 2017, 6:07 PM.
Worker: Fixed unittest
1fb8aea2c8af
·Sybren A. Stüvel (sybren) on Jan 4 2017, 5:44 PM.
Worker: removed now-obsolete push_to_master() calls
76e9ea8e8fc6
·Sybren A. Stüvel (sybren) on Jan 4 2017, 5:44 PM.
Worker: set activity to 'Task completed' when a task completes
2b62e2a58ec9
·Sybren A. Stüvel (sybren) on Jan 4 2017, 5:41 PM.
Worker: use asyncio task scheduling to ensure activities & logs are sent.
ca618985c596
·Sybren A. Stüvel (sybren) on Jan 4 2017, 5:41 PM.
Worker: abort blender-render when complaining about missing files.
f86884ce3c51
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:52 PM.
Worker: always end a task run with a push to master
bb3ca4da08ca
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:51 PM.
Worker: implement command blender_render
66f3e5300513
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:14 PM.
Worker: renamed job type blender_render_simple to blender-render
f18964199efb
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:13 PM.
Worker: push activity updates every second (instead of every 10)
6301d754f82f
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:12 PM.
Worker: logging typo
fa4156e1dfb0
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:12 PM.
Server: slightly less verbose logging of task chunk size
d5c273bc87db
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:11 PM.
Server: renamed job type blender-simple-render to blender-render
c0fd760f5c18
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:11 PM.
Server: added Blender-style frame range support
fc9bb6657747
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:10 PM.
Worker: TaskUpdateQueue.queue() is now synchronous
ae0807d5371d
·Sybren A. Stüvel (sybren) on Jan 4 2017, 1:05 PM.
Worker: subprocess timeout now results in a CommandExecutionError
39a941689209
·Sybren A. Stüvel (sybren) on Jan 4 2017, 1:01 PM.
Worker: implemented subprocess execution using asyncio
b823e2dbb58c
·Sybren A. Stüvel (sybren) on Jan 4 2017, 12:22 PM.
Worker: trunner.execute() always returns a boolean (never None)
e2aab4055ac6
·Sybren A. Stüvel (sybren) on Jan 4 2017, 12:21 PM.
Worker: set up proper logging in test_worker.py
19977e7fd7d3
·Sybren A. Stüvel (sybren) on Jan 4 2017, 12:21 PM.
Worker: close asyncio loop at end of run
5ccad033077d
·Sybren A. Stüvel (sybren) on Jan 4 2017, 12:21 PM.
Worker: construct ProactorEventLoop on Windows
ed2e6097e86b
·Sybren A. Stüvel (sybren) on Jan 4 2017, 10:35 AM.
Worker: HTTP calls to Master are performed asynchronously & in a diff thread
8d2a7d24c01b
·Sybren A. Stüvel (sybren) on Jan 4 2017, 10:28 AM.

Jan 3 2017

Worker: fixed unittest
777d8353d256
·Sybren A. Stüvel (sybren) on Jan 3 2017, 5:52 PM.
Worker: queue task updates in a persistent sqlite database
eb8c12b1be27
·Sybren A. Stüvel (sybren) on Jan 3 2017, 5:49 PM.
Manager: clarified comment
74695f13a6ea
·Sybren A. Stüvel (sybren) on Jan 3 2017, 5:37 PM.
Worker: moved mocked responses into their own python file.
817added1c73
·Sybren A. Stüvel (sybren) on Jan 3 2017, 3:33 PM.
Worker: store the authentication info on the FlamencoManager object.
53cc7e64a3af
·Sybren A. Stüvel (sybren) on Jan 3 2017, 12:29 PM.
Worker: cleanly shut down when unable to register at Manager.
08bf484a7dae
·Sybren A. Stüvel (sybren) on Jan 3 2017, 12:19 PM.
Server: allow is_flamenco_project() for projects without extension props
408d48773f0c
·Sybren A. Stüvel (sybren) on Jan 3 2017, 12:07 PM.
Worker: PEP8 formatting
5c88b21b698c
·Sybren A. Stüvel (sybren) on Jan 3 2017, 11:06 AM.
Worker: Made shutdown-behaviour more reliable, and fixed unittest.
6a737beb7834
·Sybren A. Stüvel (sybren) on Jan 3 2017, 11:04 AM.
Worker: simplified call
0493ff50e294
·Sybren A. Stüvel (sybren) on Jan 3 2017, 10:51 AM.
Worker: documented AbstractCommand.execute() return value interpretation
04a618436270
·Sybren A. Stüvel (sybren) on Jan 3 2017, 10:51 AM.
Worker: queued log entries are now protected with a lock.
c9dd095288bf
·Sybren A. Stüvel (sybren) on Jan 3 2017, 10:50 AM.
Worker: some extra logging
52fe0bda31f7
·Sybren A. Stüvel (sybren) on Jan 3 2017, 10:47 AM.
Worker: made register_log() and register_task_update() async funcs
e1971853e29b
·Sybren A. Stüvel (sybren) on Jan 3 2017, 10:47 AM.
Manager: added some comments
05f947231174
·Sybren A. Stüvel (sybren) on Jan 3 2017, 10:36 AM.
Worker: register_log() now supports variable arguments (like logging module)
0896704f228c
·Sybren A. Stüvel (sybren) on Jan 3 2017, 9:23 AM.
Worker: Moved literal constant to a named constant
6ffe9533f453
·Sybren A. Stüvel (sybren) on Jan 3 2017, 9:23 AM.
Worker: master → manager
cecbe7cf8993
·Sybren A. Stüvel (sybren) on Jan 3 2017, 9:22 AM.

Dec 23 2016

Manager: added TODO
bb6506a6dd1b
·Sybren A. Stüvel (sybren) on Dec 23 2016, 5:41 PM.
Manager: Locally apply task status change to our cached version of the task too
7783d9df0c72
·Sybren A. Stüvel (sybren) on Dec 23 2016, 5:41 PM.
Worker: implemented 'exec' command that can run arbitrary CLI commands.
3092c6d94837
·Sybren A. Stüvel (sybren) on Dec 23 2016, 5:29 PM.
Worker: properly handle task updates without changing task status.
64d5b3cdf418
·Sybren A. Stüvel (sybren) on Dec 23 2016, 4:48 PM.
Worker: Add timestamp to log entries.
56fa64ea887b
·Sybren A. Stüvel (sybren) on Dec 23 2016, 4:48 PM.
Manager: store worker remote address when registering.
aa3af967350a
·Sybren A. Stüvel (sybren) on Dec 23 2016, 4:48 PM.
Worker: echo & sleep are working and sending proper status & log to Master
3322cdabae4d
·Sybren A. Stüvel (sybren) on Dec 23 2016, 4:30 PM.
Worker: pushing activity and logs to Master
bd7fc0d75db8
·Sybren A. Stüvel (sybren) on Dec 23 2016, 4:09 PM.
Server: accepting task status/activity/log updates.
3a32141fe0f5
·Sybren A. Stüvel (sybren) on Dec 23 2016, 2:32 PM.
Manager: finished task status/log/activity updates
ccdfc573a3f6
·Sybren A. Stüvel (sybren) on Dec 23 2016, 2:27 PM.
Manager: moved sending of JSON to our own http module.
affa6743dd84
·Sybren A. Stüvel (sybren) on Dec 23 2016, 12:07 PM.
Manager: implemented queued task update pushing to upstream Server
131382dc9a36
·Sybren A. Stüvel (sybren) on Dec 23 2016, 12:00 PM.
Manager: don't error when counting empty collection
f69e8c473e62
·Sybren A. Stüvel (sybren) on Dec 23 2016, 12:00 PM.
Manager: more explicit branch between TLS and non-TLS
e38d64aff874
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:56 AM.
Manager: convert int to time.Duration while loading settings.
d4734939935f
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:53 AM.
Manager: Separated timer functionality from UpstreamConnection
f1de6775cc43
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:40 AM.
Manager: don't omit empty ints, as we should store a zero value too.
3eec88c4d96a
·Sybren A. Stüvel (sybren) on Dec 23 2016, 10:18 AM.