57 Commits

Author SHA1 Message Date
e4b07c385c Toy workflow addition 2023-06-09 10:57:08 +02:00
afa764ad67 Making sure ports are only opened for active patterns 2023-05-27 19:31:00 +02:00
81091df34b Final touches 2023-05-27 18:48:11 +02:00
933d568fb2 added time to all events. this is a unix timestamp so will need to be converted to something nicer if dispalyed, but hey, its easy to store 2023-04-27 15:13:47 +02:00
d3eb2dbf9f added standardised job creation 2023-04-22 21:48:33 +02:00
f306d8b6f2 updated runner structure so that handlers and conductors actually pull from queues in the runner. changes to logic in both are extensive, but most individual functinos are unaffected. I've also moved several functions that were part of individual monitor, handler and conductors to the base classes. 2023-04-20 17:08:06 +02:00
b87fd43cfd setup for rework of monitor/handler/conductor interactions 2023-04-18 16:24:08 +02:00
ddca1f6aa4 integrated threadsafe status updates 2023-04-18 13:50:20 +02:00
547d5fefce refactored correctness dir away from core sub dir into either functionality or core as appropriate 2023-03-31 15:55:16 +02:00
5952b02be4 added support for directory event matching 2023-03-31 13:51:14 +02:00
14dec78756 condensed hint messages a bit 2023-03-31 12:55:29 +02:00
6b532e8a70 added more hinting to pattern validation messages 2023-03-31 12:51:12 +02:00
311c98f7f2 rewored rules to only invoke base rule, and added bash jobs 2023-03-30 11:33:15 +02:00
747f2c316c added type hinting for new functions 2023-03-16 15:30:37 +01:00
9bf62af31a added functions from runner to get monitor, handler and conductors 2023-03-16 14:50:04 +01:00
f1f16ca3b8 added naming to monitors, handlers and conductors so runners can identify them, in prep for in-workflow modification of patterns and recipes' 2023-03-16 13:53:01 +01:00
ede29f3158 reformated imports for pep8 compatability 2023-03-14 15:12:22 +01:00
40ed98000b reformatted imports to work better on other machines, plus added benchmarking to project 2023-03-13 11:32:45 +01:00
486c92f6da cleared up test_runner 2023-02-24 10:38:02 +01:00
fcd897f2ff added requirement tests 2023-02-14 18:58:37 +01:00
4d29ced83d added test for reqs structuring 2023-02-13 19:34:32 +01:00
9b744e9afe resolved circular dependencies in validation by splitting meow off too 2023-02-10 18:40:15 +01:00
6fab2f7a10 also refactored core.meow into seperate files in hope that it'll help solve circular imports 2023-02-10 16:23:24 +01:00
b8885146fa added missing return call in new id generation funcs 2023-02-10 15:33:01 +01:00
7059a7340d seperated out rule and job id generation 2023-02-10 15:09:51 +01:00
7f8b4f3e32 split functionality file across new module as was getting too long on its own. All functions remian the same, but imports will need to be updated. 2023-02-10 14:46:46 +01:00
abffeed9db added some more tests for job execution and ensured an error file is always produced but failed jobs 2023-02-09 16:10:10 +01:00
a2df62c693 reformted jobs being passed to conductors so they only get a job directory and have to read the definitions from the appropriate files 2023-02-09 15:22:26 +01:00
d0a824c80f cleaned up a few loose imports no longer needed and commented out code 2023-02-09 09:28:42 +01:00
d918a1bdc1 accomdated windows differing connection types in wait function 2023-02-08 15:44:26 +01:00
d9df9c3cb2 resolved merge conflicts 2023-02-08 15:37:12 +01:00
1e1b142849 Deleted print statements 2023-02-08 15:05:33 +01:00
a1451881ae updated code so should work on windows, with exception of waiting on multiple connections 2023-02-08 14:46:03 +01:00
37d061b06a Added Pipeconnection for Windows and os.path.join, rather than hardcoded path combine 2023-02-08 14:32:16 +01:00
d787e37adc added a few more comments 2023-02-03 16:29:49 +01:00
bc7a043225 removed fake watchdog events as they were uncessary, and added a few more tests for good measure 2023-02-03 15:14:43 +01:00
47f9fe73fa differentiated papermill and python jobs more clearly 2023-02-03 14:47:16 +01:00
1b638ec496 moved sweep definitions to base pattern 2023-02-03 10:47:51 +01:00
64aaf46196 standardised event construction and validation a bit more 2023-02-02 17:41:18 +01:00
636d70f4e8 added python handler, and reworked handler and conductor event/job discovery to be more modular 2023-02-01 17:43:16 +01:00
5acb8c230e tidied up job creation a bit more 2023-02-01 15:04:06 +01:00
69cf90554d moved notebook declarations to tests/shared.py 2023-01-31 16:09:16 +01:00
b95042c5ca added comments throughout 2023-01-31 14:36:38 +01:00
31d06af5bf added rudimentary conductor for job execution 2023-01-26 13:47:17 +01:00
75de8147be updated event dict to always include path, should be more future proof 2023-01-20 11:03:16 +01:00
be2a9beff3 added interaction for monitor state updating 2023-01-15 13:44:53 +01:00
6ab9c84745 added support for retroactive event recognition 2023-01-15 10:57:44 +01:00
eabedb4747 moved runner to own file as will be heavily expanded 2023-01-15 10:10:29 +01:00
ee81b2561e added support for multiple monitors and handlers 2023-01-13 18:53:02 +01:00
2cd92c04fa some cleanup of unneeded imports and other small cleanups 2023-01-13 18:15:15 +01:00