Diffusion Flamenco Worker (master) History

flamenco-worker/packages
master96d338dccf642fd1f285967…

Jan 13 2017

Server: typo
96d338dccf64
·Sybren A. Stüvel (sybren) on Jan 13 2017, 2:37 PM.
Server: re-enabled some disabled test code
0165b250f01e
·Sybren A. Stüvel (sybren) on Jan 13 2017, 2:36 PM.
Server: subscribers now have access to jobs & tasks
7b65ab8ba78a
·Sybren A. Stüvel (sybren) on Jan 13 2017, 2:36 PM.
Worker: bumped version to 1.0-beta
d81efc5e603b
·Sybren A. Stüvel (sybren) on Jan 13 2017, 12:10 PM.
Manager: switch → select
8aae4d537a9e
·Sybren A. Stüvel (sybren) on Jan 13 2017, 11:58 AM.
Server: return if we know we don't need to do anything
bf24eae95d2d
·Sybren A. Stüvel (sybren) on Jan 13 2017, 11:56 AM.
Manager: expanded example configuration
264d98a5db0f
·Sybren A. Stüvel (sybren) on Jan 13 2017, 11:55 AM.
Manager: some logging tweaks
09accf9b273c
·Sybren A. Stüvel (sybren) on Jan 13 2017, 11:43 AM.
Worker: logging config is now stored in config file
4c427a980676
·Sybren A. Stüvel (sybren) on Jan 13 2017, 11:34 AM.

Jan 12 2017

Manager: attempt at preventing hanging at shutdown
a74bcabc4d5f
·Sybren A. Stüvel (sybren) on Jan 12 2017, 11:11 PM.
Manager: print when connecting to MongoDB
8bb8410bfca0
·Sybren A. Stüvel (sybren) on Jan 12 2017, 11:08 PM.
Manager: replaced build-via-nested-docker with build-via-docker
b5a56be0ebf8
·Sybren A. Stüvel (sybren) on Jan 12 2017, 8:19 PM.
Manager: build-via-latest-docker now also sets correct GID
e3cd7cd9c850
·Sybren A. Stüvel (sybren) on Jan 12 2017, 8:18 PM.
Manager: build-via-nested-docker now uses latest Go
0ef95b3224de
·Sybren A. Stüvel (sybren) on Jan 12 2017, 8:18 PM.
Manager: force shutdown after 2 seconds
421ccb957d90
·Sybren A. Stüvel (sybren) on Jan 12 2017, 8:06 PM.
Server: show activity on task view.
6155c5c9b844
·Sybren A. Stüvel (sybren) on Jan 12 2017, 7:47 PM.
Manager: fail active tasks when for N seconds the worker hasn't touched it
2cc83ea3079d
·Sybren A. Stüvel (sybren) on Jan 12 2017, 7:47 PM.
Manager: run shutdown routine in coroutine, so that double Ctrl+C panics
e69eabcc1909
·Sybren A. Stüvel (sybren) on Jan 12 2017, 7:13 PM.
Manager: cleanly shutdown upon SIGINT / Ctrl+C
3b27e100612c
·Sybren A. Stüvel (sybren) on Jan 12 2017, 6:59 PM.
Server: fix crashes when there are no jobs/tasks
65833d979eab
·Sybren A. Stüvel (sybren) on Jan 12 2017, 6:12 PM.
Server: another fix (see prev commit)
0a87beb77d7a
·Sybren A. Stüvel (sybren) on Jan 12 2017, 6:02 PM.
Server: fix for projects without Flamenco
930ed9ccb5fd
·Sybren A. Stüvel (sybren) on Jan 12 2017, 6:01 PM.
Server: fixed paths in rsync_ui.sh
dd452ac20327
·Sybren A. Stüvel (sybren) on Jan 12 2017, 5:40 PM.
Server: made rsync_ui.sh executable
fadcfead77fe
·Sybren A. Stüvel (sybren) on Jan 12 2017, 5:36 PM.
Server: added deploy.sh
0a9b2d195621
·Sybren A. Stüvel (sybren) on Jan 12 2017, 5:32 PM.
Server: removed svn dependency
5e449e4cd37d
·Sybren A. Stüvel (sybren) on Jan 12 2017, 4:57 PM.
Removed old Flamenco Manager
a8c04fc52354
·Sybren A. Stüvel (sybren) on Jan 12 2017, 4:38 PM.
Deleted old Python 2 Flamenco Worker
c9c415f29f5c
·Sybren A. Stüvel (sybren) on Jan 12 2017, 4:37 PM.
Server: remove unused code
3bd70826e2ed
·Sybren A. Stüvel (sybren) on Jan 12 2017, 4:18 PM.
Manager: added TODO
63fe72e6cd0c
·Sybren A. Stüvel (sybren) on Jan 12 2017, 4:18 PM.
Server: transition cancel-requested → canceled automatically if appliccable
88272616a26c
·Sybren A. Stüvel (sybren) on Jan 12 2017, 3:38 PM.
Server: allow task cancel & re-queue from web interface
f14dbb80e335
·Sybren A. Stüvel (sybren) on Jan 12 2017, 3:36 PM.
Server: renamed JobManager.set_job_status() to api_set_job_status()
60b52d6f63be
·Sybren A. Stüvel (sybren) on Jan 12 2017, 3:35 PM.
Manager: warn when a worker has no supported job types.
351cad264c8d
·Sybren A. Stüvel (sybren) on Jan 12 2017, 3:32 PM.
Manager: keep track of when we've last seen a worker & task update.
07536bd2b665
·Sybren A. Stüvel (sybren) on Jan 12 2017, 3:32 PM.
Server: allow PATCHing of jobs to set their status.
3aae059fa160
·Sybren A. Stüvel (sybren) on Jan 12 2017, 1:43 PM.
Server: removed unused code & fixed indentation
de929809abcc
·Sybren A. Stüvel (sybren) on Jan 12 2017, 1:42 PM.
Server: allow task PATCH to flamenco admins, and not to Managers.
f9306279227e
·Sybren A. Stüvel (sybren) on Jan 12 2017, 12:57 PM.
Manager: removed PATCH code
bb23aa9687cf
·Sybren A. Stüvel (sybren) on Jan 12 2017, 12:30 PM.
Server: removed fake columns, added text to status column
acc7b0c56620
·Sybren A. Stüvel (sybren) on Jan 12 2017, 11:38 AM.
Server: cleaned up front-end routes, Jade files and some JS
77429dc4effa
·Sybren A. Stüvel (sybren) on Jan 12 2017, 11:30 AM.
Server: added blender_render.py to create render jobs
15d9595a2756
·Sybren A. Stüvel (sybren) on Jan 12 2017, 11:30 AM.

Jan 11 2017

Worker: added TODO to readme
69c87273a1d5
·Sybren A. Stüvel (sybren) on Jan 11 2017, 1:35 PM.
Manager: more thorough handling of cancel-requested task status
7c67d6a97c0a
·Sybren A. Stüvel (sybren) on Jan 11 2017, 1:35 PM.
Server: job status 'cancel-requested' + update job after task status change
27c4eed4e465
·Sybren A. Stüvel (sybren) on Jan 11 2017, 1:35 PM.
Server: fixed unittest
3073789c7c3a
·Sybren A. Stüvel (sybren) on Jan 11 2017, 1:35 PM.
Server: moved some task/job status set/assert code to AbstractFlamencoTest
97e059d87a02
·Sybren A. Stüvel (sybren) on Jan 11 2017, 1:35 PM.

Jan 10 2017

Server: some small fixes to get the blender-render command working
d83c6ba0d2a3
·Sybren A. Stüvel (sybren) on Jan 10 2017, 5:40 PM.
Server: schedule tasks by priority
28b123733312
·Sybren A. Stüvel (sybren) on Jan 10 2017, 4:07 PM.
Server: added role 'flamenco-admin' + CLI cmds to grant/revoke
9d7a8ad8e117
·Sybren A. Stüvel (sybren) on Jan 10 2017, 3:53 PM.
Manager: added TODO
26e2bb10882a
·Sybren A. Stüvel (sybren) on Jan 10 2017, 3:34 PM.
Worker: only log outgoing JSON if there is any.
5a59166e190a
·Sybren A. Stüvel (sybren) on Jan 10 2017, 3:07 PM.
Worker: changed command identifier
cd8043f91a8b
·Sybren A. Stüvel (sybren) on Jan 10 2017, 3:07 PM.
Worker: added may-I-run loop, aborting the current task if the answer is no
9a1ce50af286
·Sybren A. Stüvel (sybren) on Jan 10 2017, 3:05 PM.
Manager: ensure that cancel-requested tasks do not transition to active
cc4f77c97982
·Sybren A. Stüvel (sybren) on Jan 10 2017, 3:00 PM.
Server: ensure that cancel-requested tasks do not transition to active
3ccc9b580dfa
·Sybren A. Stüvel (sybren) on Jan 10 2017, 2:59 PM.
Manager: receive a list of tasks to cancel from the Server
b5ec5ec73f59
·Sybren A. Stüvel (sybren) on Jan 10 2017, 12:04 PM.
Manager: fixed bug in unittest
b70cb12e5200
·Sybren A. Stüvel (sybren) on Jan 10 2017, 12:03 PM.
Server: Added task status 'cancel-requested'
ed0420e9cdcb
·Sybren A. Stüvel (sybren) on Jan 10 2017, 12:00 PM.
Manager: documented communication between server and manager
1ee01fca4fcb
·Sybren A. Stüvel (sybren) on Jan 10 2017, 11:36 AM.
Manager: moved some common test code to gocheck_test.go
7fbd44372d9d
·Sybren A. Stüvel (sybren) on Jan 10 2017, 11:35 AM.
Manager: moved gocheck integration to separate file.
d6f2826c925f
·Sybren A. Stüvel (sybren) on Jan 10 2017, 10:51 AM.

Jan 6 2017

Manager: Added endpoint /may-i-run/{task-id} so Workers can check status
86bc5c73f46e
·Sybren A. Stüvel (sybren) on Jan 6 2017, 4:49 PM.
Manager: use etag to re-fetch queued task before handing it to Worker
ba3276349a7b
·Sybren A. Stüvel (sybren) on Jan 6 2017, 4:01 PM.
Server: allow managers to re-fetch their own tasks.
344b071c1fdc
·Sybren A. Stüvel (sybren) on Jan 6 2017, 3:59 PM.
Manager: re-fetch task from Server before handing it to worker
983e78b28178
·Sybren A. Stüvel (sybren) on Jan 6 2017, 2:55 PM.
Manager: prevent asking scheduler for 0 tasks
375968678194
·Sybren A. Stüvel (sybren) on Jan 6 2017, 1:54 PM.
Manager: a running task should go to state 'active', not 'processing'
6a86c2ad6dce
·Sybren A. Stüvel (sybren) on Jan 6 2017, 1:54 PM.
Manager: allow Timer to do both sleep-ping and ping-sleep
0e19a20582aa
·Sybren A. Stüvel (sybren) on Jan 6 2017, 1:54 PM.
Manager: Configuring logging to show the file from which was logged
584c765cf260
·Sybren A. Stüvel (sybren) on Jan 6 2017, 1:53 PM.
Worker: added some documentation
c441803bed78
·Sybren A. Stüvel (sybren) on Jan 6 2017, 11:18 AM.
Worker: more explicit shutdown of what's currently running upon Ctrl+C
1d32c6a0fd9d
·Sybren A. Stüvel (sybren) on Jan 6 2017, 11:17 AM.
Worker: report on asyncio tasks when shutting down.
80a26aa49444
·Sybren A. Stüvel (sybren) on Jan 6 2017, 11:17 AM.
Worker: PEP8 formatting
013b11989424
·Sybren A. Stüvel (sybren) on Jan 6 2017, 10:42 AM.
Worker: cleaner shutdown on Ctrl+C
fb9c177f9271
·Sybren A. Stüvel (sybren) on Jan 6 2017, 10:42 AM.

Jan 5 2017

Server: Changes in the job status also affect the job's task statuses.
0830a457a129
·Sybren A. Stüvel (sybren) on Jan 5 2017, 5:45 PM.
Server: tweaked blender-render job compiler
066208604ccd
·Sybren A. Stüvel (sybren) on Jan 5 2017, 5:42 PM.
Server: removed task status 'processing'
e5fc8c527a04
·Sybren A. Stüvel (sybren) on Jan 5 2017, 5:41 PM.
Server: update job status based on change in task status.
d09bb1228fe5
·Sybren A. Stüvel (sybren) on Jan 5 2017, 3:59 PM.
Server: added FlamencoExtension.update_status()
70041585a543
·Sybren A. Stüvel (sybren) on Jan 5 2017, 3:58 PM.
Server: typo in comment
b440b86257d1
·Sybren A. Stüvel (sybren) on Jan 5 2017, 3:55 PM.
Manager: fixed unittests
318046952a84
·Sybren A. Stüvel (sybren) on Jan 5 2017, 1:52 PM.

Jan 4 2017

Worker: push updates to manager before shutting down
20b9cf289490
·Sybren A. Stüvel (sybren) on Jan 4 2017, 6:08 PM.
Worker: set last_log_push and last_activity_push to now() using factory
c813ed28b6fb
·Sybren A. Stüvel (sybren) on Jan 4 2017, 6:07 PM.
Worker: better asyncio loop management in unit tests
4e98b8fec08c
·Sybren A. Stüvel (sybren) on Jan 4 2017, 6:07 PM.
Worker: Fixed unittest
1fb8aea2c8af
·Sybren A. Stüvel (sybren) on Jan 4 2017, 5:44 PM.
Worker: removed now-obsolete push_to_master() calls
76e9ea8e8fc6
·Sybren A. Stüvel (sybren) on Jan 4 2017, 5:44 PM.
Worker: set activity to 'Task completed' when a task completes
2b62e2a58ec9
·Sybren A. Stüvel (sybren) on Jan 4 2017, 5:41 PM.
Worker: use asyncio task scheduling to ensure activities & logs are sent.
ca618985c596
·Sybren A. Stüvel (sybren) on Jan 4 2017, 5:41 PM.
Worker: abort blender-render when complaining about missing files.
f86884ce3c51
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:52 PM.
Worker: always end a task run with a push to master
bb3ca4da08ca
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:51 PM.
Worker: implement command blender_render
66f3e5300513
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:14 PM.
Worker: renamed job type blender_render_simple to blender-render
f18964199efb
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:13 PM.
Worker: push activity updates every second (instead of every 10)
6301d754f82f
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:12 PM.
Worker: logging typo
fa4156e1dfb0
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:12 PM.
Server: slightly less verbose logging of task chunk size
d5c273bc87db
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:11 PM.
Server: renamed job type blender-simple-render to blender-render
c0fd760f5c18
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:11 PM.
Server: added Blender-style frame range support
fc9bb6657747
·Sybren A. Stüvel (sybren) on Jan 4 2017, 4:10 PM.
Worker: TaskUpdateQueue.queue() is now synchronous
ae0807d5371d
·Sybren A. Stüvel (sybren) on Jan 4 2017, 1:05 PM.
Worker: subprocess timeout now results in a CommandExecutionError
39a941689209
·Sybren A. Stüvel (sybren) on Jan 4 2017, 1:01 PM.