Commit Graph

75 Commits

Author SHA1 Message Date
83ee6b2d55 Added previous work to new repo 2023-05-06 21:06:53 +02:00
PatchOfScotland
933d568fb2 added time to all events. this is a unix timestamp so will need to be converted to something nicer if dispalyed, but hey, its easy to store 2023-04-27 15:13:47 +02:00
PatchOfScotland
d3eb2dbf9f added standardised job creation 2023-04-22 21:48:33 +02:00
PatchOfScotland
f306d8b6f2 updated runner structure so that handlers and conductors actually pull from queues in the runner. changes to logic in both are extensive, but most individual functinos are unaffected. I've also moved several functions that were part of individual monitor, handler and conductors to the base classes. 2023-04-20 17:08:06 +02:00
PatchOfScotland
b87fd43cfd setup for rework of monitor/handler/conductor interactions 2023-04-18 16:24:08 +02:00
PatchOfScotland
ddca1f6aa4 integrated threadsafe status updates 2023-04-18 13:50:20 +02:00
PatchOfScotland
3f28b11be9 added a proper version of job update protection 2023-04-14 16:15:36 +02:00
PatchOfScotland
9aa8217957 undid last commit as it would prevent anything ever being removed 2023-04-14 15:44:31 +02:00
PatchOfScotland
2bba56fdf8 updated status updating to merge in a more accomodating manner 2023-04-14 15:40:42 +02:00
PatchOfScotland
c57198919b added functions to update job status files in a threadsafe manner 2023-04-14 15:28:27 +02:00
PatchOfScotland
547d5fefce refactored correctness dir away from core sub dir into either functionality or core as appropriate 2023-03-31 15:55:16 +02:00
PatchOfScotland
5952b02be4 added support for directory event matching 2023-03-31 13:51:14 +02:00
PatchOfScotland
0c6977ecd3 standardised naming of test recipe scripts 2023-03-31 11:41:38 +02:00
PatchOfScotland
18d579da22 added tests for new bash jobs, and removed extra hash definition in job dict 2023-03-30 14:20:29 +02:00
PatchOfScotland
311c98f7f2 rewored rules to only invoke base rule, and added bash jobs 2023-03-30 11:33:15 +02:00
PatchOfScotland
747f2c316c added type hinting for new functions 2023-03-16 15:30:37 +01:00
PatchOfScotland
9bf62af31a added functions from runner to get monitor, handler and conductors 2023-03-16 14:50:04 +01:00
PatchOfScotland
f1f16ca3b8 added naming to monitors, handlers and conductors so runners can identify them, in prep for in-workflow modification of patterns and recipes' 2023-03-16 13:53:01 +01:00
PatchOfScotland
9547df7612 added -s option to test to skip time consuming tests. also updated readme accordingly 2023-03-16 13:25:44 +01:00
PatchOfScotland
ede29f3158 reformated imports for pep8 compatability 2023-03-14 15:12:22 +01:00
PatchOfScotland
af489d2bb9 added test for get_recipe_from_notebook 2023-03-14 13:39:01 +01:00
PatchOfScotland
40ed98000b reformatted imports to work better on other machines, plus added benchmarking to project 2023-03-13 11:32:45 +01:00
PatchOfScotland
c01df1b190 added test to check that adding pattern and recipe to monitor behaves correctly 2023-03-07 16:34:49 +01:00
PatchOfScotland
486c92f6da cleared up test_runner 2023-02-24 10:38:02 +01:00
PatchOfScotland
b9063e1743 added requirements file 2023-02-20 14:18:22 +01:00
PatchOfScotland
8e34a50891 added implemenation and test for module versioning 2023-02-15 00:41:39 +01:00
PatchOfScotland
fcd897f2ff added requirement tests 2023-02-14 18:58:37 +01:00
PatchOfScotland
4d29ced83d added test for reqs structuring 2023-02-13 19:34:32 +01:00
PatchOfScotland
7dd654bb8c added a parameter sweep execution test 2023-02-11 23:27:03 +01:00
PatchOfScotland
59c352904b added helper function to create parameter sweep, plus appropriate test 2023-02-11 23:12:18 +01:00
PatchOfScotland
9b744e9afe resolved circular dependencies in validation by splitting meow off too 2023-02-10 18:40:15 +01:00
PatchOfScotland
89a0700e1d split up meow tests 2023-02-10 16:28:55 +01:00
PatchOfScotland
6fab2f7a10 also refactored core.meow into seperate files in hope that it'll help solve circular imports 2023-02-10 16:23:24 +01:00
PatchOfScotland
7059a7340d seperated out rule and job id generation 2023-02-10 15:09:51 +01:00
PatchOfScotland
908ecf9950 split up functionality tests into different classes per file 2023-02-10 15:00:04 +01:00
PatchOfScotland
7f8b4f3e32 split functionality file across new module as was getting too long on its own. All functions remian the same, but imports will need to be updated. 2023-02-10 14:46:46 +01:00
PatchOfScotland
dfd83e28dc removed some rogue print statements 2023-02-10 11:05:44 +01:00
PatchOfScotland
c0411c43a4 added tests for handlers and conductors validating events and jobs 2023-02-09 17:29:21 +01:00
PatchOfScotland
abffeed9db added some more tests for job execution and ensured an error file is always produced but failed jobs 2023-02-09 16:10:10 +01:00
PatchOfScotland
a2df62c693 reformted jobs being passed to conductors so they only get a job directory and have to read the definitions from the appropriate files 2023-02-09 15:22:26 +01:00
PatchOfScotland
d9df9c3cb2 resolved merge conflicts 2023-02-08 15:37:12 +01:00
toppggg
ca10fd6dc7 Added line 89 assert again 2023-02-08 15:26:06 +01:00
toppggg
2899d44a00 Deleted print statements 2023-02-08 15:03:44 +01:00
PatchOfScotland
a1451881ae updated code so should work on windows, with exception of waiting on multiple connections 2023-02-08 14:46:03 +01:00
toppggg
37d061b06a Added Pipeconnection for Windows and os.path.join, rather than hardcoded path combine 2023-02-08 14:32:16 +01:00
PatchOfScotland
9435d500db added a few more tests, most notably of python execution 2023-02-03 16:07:09 +01:00
PatchOfScotland
bc7a043225 removed fake watchdog events as they were uncessary, and added a few more tests for good measure 2023-02-03 15:14:43 +01:00
PatchOfScotland
47f9fe73fa differentiated papermill and python jobs more clearly 2023-02-03 14:47:16 +01:00
PatchOfScotland
72d6b263b7 removed surplus imports 2023-02-03 10:50:18 +01:00
PatchOfScotland
1b638ec496 moved sweep definitions to base pattern 2023-02-03 10:47:51 +01:00