Commit Graph

21 Commits

Author SHA1 Message Date
d3eb2dbf9f added standardised job creation 2023-04-22 21:48:33 +02:00
f306d8b6f2 updated runner structure so that handlers and conductors actually pull from queues in the runner. changes to logic in both are extensive, but most individual functinos are unaffected. I've also moved several functions that were part of individual monitor, handler and conductors to the base classes. 2023-04-20 17:08:06 +02:00
ddca1f6aa4 integrated threadsafe status updates 2023-04-18 13:50:20 +02:00
547d5fefce refactored correctness dir away from core sub dir into either functionality or core as appropriate 2023-03-31 15:55:16 +02:00
f1f16ca3b8 added naming to monitors, handlers and conductors so runners can identify them, in prep for in-workflow modification of patterns and recipes' 2023-03-16 13:53:01 +01:00
ede29f3158 reformated imports for pep8 compatability 2023-03-14 15:12:22 +01:00
40ed98000b reformatted imports to work better on other machines, plus added benchmarking to project 2023-03-13 11:32:45 +01:00
9b744e9afe resolved circular dependencies in validation by splitting meow off too 2023-02-10 18:40:15 +01:00
6fab2f7a10 also refactored core.meow into seperate files in hope that it'll help solve circular imports 2023-02-10 16:23:24 +01:00
7f8b4f3e32 split functionality file across new module as was getting too long on its own. All functions remian the same, but imports will need to be updated. 2023-02-10 14:46:46 +01:00
c0411c43a4 added tests for handlers and conductors validating events and jobs 2023-02-09 17:29:21 +01:00
abffeed9db added some more tests for job execution and ensured an error file is always produced but failed jobs 2023-02-09 16:10:10 +01:00
a2df62c693 reformted jobs being passed to conductors so they only get a job directory and have to read the definitions from the appropriate files 2023-02-09 15:22:26 +01:00
1eb022f79e added comments to local python constructor 2023-02-09 09:36:22 +01:00
a1451881ae updated code so should work on windows, with exception of waiting on multiple connections 2023-02-08 14:46:03 +01:00
47f9fe73fa differentiated papermill and python jobs more clearly 2023-02-03 14:47:16 +01:00
64aaf46196 standardised event construction and validation a bit more 2023-02-02 17:41:18 +01:00
636d70f4e8 added python handler, and reworked handler and conductor event/job discovery to be more modular 2023-02-01 17:43:16 +01:00
deb24f33ff updated conductor so it updates job meta files with statues 2023-02-01 11:25:03 +01:00
b95042c5ca added comments throughout 2023-01-31 14:36:38 +01:00
31d06af5bf added rudimentary conductor for job execution 2023-01-26 13:47:17 +01:00