Diffusion Flamenco Worker (wip-double-running) History

flamenco-worker/packages
wip-double-runninge04a2a3c66499776277d847…

Jan 27 2017

Server: blender-render task now first moves existing render output dir aside
e04a2a3c6649
·Sybren A. Stüvel (sybren) on Jan 27 2017, 11:55 AM.
Server: handled class name to command name in a more generic way
51676abc3c18
·Sybren A. Stüvel (sybren) on Jan 27 2017, 11:53 AM.
Server: PEP8 formatting
28cffa03bf9b
·Sybren A. Stüvel (sybren) on Jan 27 2017, 10:55 AM.
Server: added /f/{p-url}/jobs/{job-id}/depsgraph endpoint to draw depsgraph
77b636269b95
·Sybren A. Stüvel (sybren) on Jan 27 2017, 10:55 AM.
Bumped version to 2.0-beta8
8802ff768ebd
·Sybren A. Stüvel (sybren) on Jan 27 2017, 9:18 AM.
Manager: use different HTTP headers to do conditional fetch of depsgraph
4bf1859860e4
·Sybren A. Stüvel (sybren) on Jan 27 2017, 9:18 AM.
Server: use different HTTP headers to do conditional fetch of depsgraph
bc600269937f
·Sybren A. Stüvel (sybren) on Jan 27 2017, 9:18 AM.

Jan 26 2017

Bumped version to 2.0-beta7
bde4d6dd74a3
·Sybren A. Stüvel (sybren) on Jan 26 2017, 6:05 PM.
Server: .../depsgrahp: format Last-Modified header in ISO-8601 format
75948217d1ea
·Sybren A. Stüvel (sybren) on Jan 26 2017, 6:03 PM.
Manager: /depsgraph: store & use Last-Modified header contents as string
6eb0ed68dd09
·Sybren A. Stüvel (sybren) on Jan 26 2017, 6:02 PM.
Server: fixed Last-Modified HTTP header format
fa70da031fe1
·Sybren A. Stüvel (sybren) on Jan 26 2017, 5:44 PM.
Bumped version to 2.0-beta6
088a0e3817d2
·Sybren A. Stüvel (sybren) on Jan 26 2017, 4:59 PM.
Manager: exposed version to CLI (-version) and status reports
8dc18fadf0c0
·Sybren A. Stüvel (sybren) on Jan 26 2017, 4:59 PM.
Worker: added missing 'self' argument in patch_asyncio()
54a46143b212
·Sybren A. Stüvel (sybren) on Jan 26 2017, 4:57 PM.
Bumped version to 2.0-beta5
c103ae4ff50e
·Sybren A. Stüvel (sybren) on Jan 26 2017, 4:26 PM.
Server: removed the old scheduler, and no longer setting jobs to active on fetch
35dfa36558f1
·Sybren A. Stüvel (sybren) on Jan 26 2017, 4:04 PM.
Manager: made download_task_sleep_seconds more frequent (every minute)
9f9c9b0cdc85
·Sybren A. Stüvel (sybren) on Jan 26 2017, 3:31 PM.
Manager: streamlined some logging
a25ffb1dbd08
·Sybren A. Stüvel (sybren) on Jan 26 2017, 3:31 PM.
Manager: fixed issue with TaskTimeoutChecker not killing un-pinged tasks
08fb679ba447
·Sybren A. Stüvel (sybren) on Jan 26 2017, 3:31 PM.
Manager: scheduler no longer synchronously kicks the task downloader
617a08fa1483
·Sybren A. Stüvel (sybren) on Jan 26 2017, 3:28 PM.
Manager: testing against different Mongo database
b0282136e92f
·Sybren A. Stüvel (sybren) on Jan 26 2017, 3:23 PM.
Manager: perform dependency graph based task scheduling
0ba147a7c2a4
·Sybren A. Stüvel (sybren) on Jan 26 2017, 3:01 PM.
Worker: "master" → "manager"
8690154603e7
·Sybren A. Stüvel (sybren) on Jan 26 2017, 2:58 PM.
Worker: patching asyncio to avoid an occasional crash
ad505ee8e796
·Sybren A. Stüvel (sybren) on Jan 26 2017, 10:23 AM.
Manager: fixed panic in TimeoutAfter func when timeout channel was closed
f40927268ff7
·Sybren A. Stüvel (sybren) on Jan 26 2017, 10:12 AM.
Manager: removed line that shouldn't have been committed
10d8eb0c4ce0
·Sybren A. Stüvel (sybren) on Jan 26 2017, 9:54 AM.
Manager: documented available CLI arguments
4036fbee7af8
·Sybren A. Stüvel (sybren) on Jan 26 2017, 9:52 AM.
Manager: added bson tag for SettingsInMongo
8a06de9b0440
·Sybren A. Stüvel (sybren) on Jan 26 2017, 9:52 AM.
Manager: added -cleanslate CLI argument
1a83db0b531f
·Sybren A. Stüvel (sybren) on Jan 26 2017, 9:52 AM.

Jan 25 2017

Manager: scheduler now fetches tasks from /api/f/m/{mngr-id}/depsgraph
f0dd69a4c65a
·Sybren A. Stüvel (sybren) on Jan 25 2017, 5:19 PM.
Server: implemented depsgraph endpoint
5e1cf163a6ab
·Sybren A. Stüvel (sybren) on Jan 25 2017, 4:35 PM.
Manager: added some comments
7585111f42fe
·Sybren A. Stüvel (sybren) on Jan 25 2017, 4:35 PM.
Manager: let unassigned task be assigned to worker by sending an update
075b4b3e3985
·Sybren A. Stüvel (sybren) on Jan 25 2017, 4:35 PM.
Manager: Added WorkerTestRequest and WorkerTestRequestWithBody test funcs
cea84fc5cd64
·Sybren A. Stüvel (sybren) on Jan 25 2017, 4:35 PM.
Server: Started working on depsgraph-based scheduling
8d3c0410e47f
·Sybren A. Stüvel (sybren) on Jan 25 2017, 4:35 PM.
Manager: update own URL first (based on has_tls), then log it
4558d79a9e6b
·Sybren A. Stüvel (sybren) on Jan 25 2017, 4:35 PM.
Server: added first/last links to task log viewer
cd7eccf67a68
·Sybren A. Stüvel (sybren) on Jan 25 2017, 2:21 PM.
Manager: Fix T50481: Add worker ID/address/nickname to log
aea4b55dff4e
·Sybren A. Stüvel (sybren) on Jan 25 2017, 11:01 AM.
Server: Fix T50518: Properly handle task failure
22b3d35ea9e6
·Sybren A. Stüvel (sybren) on Jan 25 2017, 10:39 AM.

Jan 24 2017

Bumped version to 2.0-beta4
1b2b1e315950
·Sybren A. Stüvel (sybren) on Jan 24 2017, 4:24 PM.
Manager: better way to run tests & get dependencies
b7f7b108ede0
·Sybren A. Stüvel (sybren) on Jan 24 2017, 4:23 PM.
Manager: removed incorrect TODO
ac53e99b551b
·Sybren A. Stüvel (sybren) on Jan 24 2017, 4:18 PM.
Worker: respond to SIGUSR1 by logging all current asyncio tasks.
8d165c137825
·Sybren A. Stüvel (sybren) on Jan 24 2017, 4:15 PM.
Worker: gracefully handle unreachable manager when signing off
c87f91823e30
·Sybren A. Stüvel (sybren) on Jan 24 2017, 4:15 PM.
Worker: removed superfluous raise_for_status() call
b9ff79972c09
·Sybren A. Stüvel (sybren) on Jan 24 2017, 4:15 PM.
Manager: log "pushing 0 updates" at debug level
b07342dafe45
·Sybren A. Stüvel (sybren) on Jan 24 2017, 4:15 PM.
Server: Added /flamenco/jobs/{job-id}/redir endpoint to redirect to job view
0fb23c0ca283
·Sybren A. Stüvel (sybren) on Jan 24 2017, 4:15 PM.
Server: removed "Tasks" link from project selector
59b673b6e51c
·Sybren A. Stüvel (sybren) on Jan 24 2017, 2:09 PM.
Server: removed activities from index page
2b5426e54fad
·Sybren A. Stüvel (sybren) on Jan 24 2017, 2:08 PM.
Manager: added TODO
15eb6d7a6a7e
·Sybren A. Stüvel (sybren) on Jan 24 2017, 9:17 AM.

Jan 23 2017

Manager: using proper log levels in Logrus
ff5c0c6f51af
·Sybren A. Stüvel (sybren) on Jan 23 2017, 11:26 AM.
Manager: using Lolrus for logging
a398dddf60f5
·Sybren A. Stüvel (sybren) on Jan 23 2017, 10:55 AM.

Jan 20 2017

Worker: added --factory-startup and --debug-cycles CLI args to blender-render
352732e48ea3
·Sybren A. Stüvel (sybren) on Jan 20 2017, 1:15 PM.
Worker: fixed bug in checking blender render settings
04cbb71c8e22
·Sybren A. Stüvel (sybren) on Jan 20 2017, 1:15 PM.
Worker: added unit test for CLI arguments in blender_cmd setting
b84589423946
·Sybren A. Stüvel (sybren) on Jan 20 2017, 1:15 PM.
Server: Loop through all settings for job type blender-render
cd050ed4cabe
·Pablo Vazquez (pablovazquez) on Jan 20 2017, 11:47 AM.
Bumped version to 2.0-beta3
ec494b47cc73
·Sybren A. Stüvel (sybren) on Jan 20 2017, 11:06 AM.
Worker: sign off at Manager upon SIGINT and SIGTERM
5f7aa10bbba9
·Sybren A. Stüvel (sybren) on Jan 20 2017, 10:44 AM.
Worker: run settings['blender_cmd'] through shlex
b00a37b26997
·Sybren A. Stüvel (sybren) on Jan 20 2017, 10:44 AM.
Worker: command runner no longer directly sets task status
20f12a5a8690
·Sybren A. Stüvel (sybren) on Jan 20 2017, 10:44 AM.
Worker: better place logging + final warning when shut down
0b2f9ead95ec
·Sybren A. Stüvel (sybren) on Jan 20 2017, 10:44 AM.
Manager: allow workers to sign off, which re-schedules their tasks
0c176d4546d8
·Sybren A. Stüvel (sybren) on Jan 20 2017, 10:44 AM.
Manager: log objectid.hex instead of the objectid object itself
de230d2a7f7d
·Sybren A. Stüvel (sybren) on Jan 20 2017, 10:44 AM.

Jan 19 2017

Server: If the worker is Blender Render, show the settings
3003d19a6aad
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 5:52 PM.
Server: Break words if they're too long
ca2ea93ad79a
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 5:51 PM.
Server: Make debug panel unique (conflicts when having job and task loaded)
a1fd8306e390
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 5:45 PM.
Server: tweaks to action buttons
3c308d31db82
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 5:44 PM.
Server: More compact jobs/tasks list
aaeab4fa1763
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 5:15 PM.
Server: Don't show IDs on the jobs list
a8097952f8d3
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 5:15 PM.
Server: Color tweaks for queued and completed statuses
6d15d0683b0c
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 5:15 PM.
Worker: added SysV init script + crontabs for SysV / systemd
ea51a6221754
·Sybren A. Stüvel (sybren) on Jan 19 2017, 5:13 PM.
Server: Color default for claimed-by-manager status
1b7025c165d7
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 4:40 PM.
Server: Fixed scrolling on jobs list
0024a452ba73
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 4:30 PM.
typo
3cefb79e39c7
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 4:00 PM.
Server: No need to clear col_main-overlay on item_open
f65e2a720271
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 4:00 PM.
Worker: allow more configuration through config file
60bdd690f6a3
·Sybren A. Stüvel (sybren) on Jan 19 2017, 3:38 PM.
Server: disabled showing task progress percentage
403c50677878
·Sybren A. Stüvel (sybren) on Jan 19 2017, 3:38 PM.
Server: Download icon for task log download
6153c679d5c3
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 3:17 PM.
Server: Neater js by Dr. Sybren
bbfdb8ffe307
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 3:17 PM.
Set the url back to the job when closing Task Details
b872c1567fbb
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 2:56 PM.
Unused item-save code left from Attract
df8d8a7ae763
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 2:56 PM.
Server: show both task and job for /f/{p}/with-task/{task-id}
bb12e6279ca8
·Sybren A. Stüvel (sybren) on Jan 19 2017, 2:54 PM.
Server: added link to download entire task log
24cf16834dc9
·Sybren A. Stüvel (sybren) on Jan 19 2017, 2:54 PM.
Worker: log all Blender output
3ee67d2c88d9
·Sybren A. Stüvel (sybren) on Jan 19 2017, 2:42 PM.
Worker: removed limit on subprocess stream reader
54fdcca563f1
·Sybren A. Stüvel (sybren) on Jan 19 2017, 2:42 PM.
Server: always end log chunks with a newline
092a99647e34
·Sybren A. Stüvel (sybren) on Jan 19 2017, 2:19 PM.
Server: added /flamenco/{project-url}/tasks/{task-id}/download-log
6cfc78ad7453
·Sybren A. Stüvel (sybren) on Jan 19 2017, 2:17 PM.
Worker: added missing section in flamenco-worker.service
be8e2588d8e4
·Sybren A. Stüvel (sybren) on Jan 19 2017, 2:07 PM.
Manager & Worker: made it possible to "systemctl enable flamenco-xxx"
aa3f850abffc
·Sybren A. Stüvel (sybren) on Jan 19 2017, 1:01 PM.
Manager: added API and web support for fetching task log entries
e810b35128e2
·Sybren A. Stüvel (sybren) on Jan 19 2017, 12:22 PM.
Server: moved SDK classes to their own sdk.py submodules
cc365fd90e17
·Sybren A. Stüvel (sybren) on Jan 19 2017, 12:22 PM.
Esc now closes the task details as well
218742e2ef95
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 11:53 AM.
Fix overlay not occupying the whole column
668f1c938a35
·Pablo Vazquez (pablovazquez) on Jan 19 2017, 11:53 AM.
Manager: set task activity to 'Clamed by manager' when that happens
2fbe758b7e6c
·Sybren A. Stüvel (sybren) on Jan 19 2017, 10:56 AM.
Manager: bugfix in worker nickname in task updates
8cb75abf4461
·Sybren A. Stüvel (sybren) on Jan 19 2017, 10:55 AM.
Server: task-embed now shows which worker handled the task
eca57981148f
·Sybren A. Stüvel (sybren) on Jan 19 2017, 10:35 AM.
Worker: set nickname to hostname upon registration
f9c85d8bc27d
·Sybren A. Stüvel (sybren) on Jan 19 2017, 10:34 AM.
Manager: accept worker's nickname upon registration
9f91ee3fbdb4
·Sybren A. Stüvel (sybren) on Jan 19 2017, 10:34 AM.
Manager: WorkerRegistration is never marshalled to bson
1503862cadd2
·Sybren A. Stüvel (sybren) on Jan 19 2017, 10:32 AM.
Manager: added service file for systemd
44307d268986
·Sybren A. Stüvel (sybren) on Jan 19 2017, 10:14 AM.