NikolajDanger/meow_base
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Commit Graph

  • 2c0b45c1f4 ✨ Small change to performance test main NikolajDanger 2023-06-18 14:34:30 +02:00
  • 04b57a6884 ✨ Small fix NikolajDanger 2023-06-18 13:22:21 +02:00
  • 904471004d ✨ HTTP implementation NikolajDanger 2023-06-18 13:17:40 +02:00
  • 7534eed13a ✨ Slight changes to performance test NikolajDanger 2023-06-09 12:59:32 +02:00
  • e4b07c385c ✨ Toy workflow addition NikolajDanger 2023-06-09 10:57:08 +02:00
  • 52ac5b6576 ✨ Changes to performance test NikolajDanger 2023-06-04 16:43:21 +02:00
  • 68a8c717e7 ✨ performance testing NikolajDanger 2023-06-02 18:00:52 +02:00
  • 0adf76af5c ✨ Small fixes NikolajDanger 2023-06-02 18:00:41 +02:00
  • 4723482dbc ✨ Extra touch NikolajDanger 2023-05-29 19:51:01 +02:00
  • afa764ad67 ✨ Making sure ports are only opened for active patterns NikolajDanger 2023-05-27 19:31:00 +02:00
  • 81091df34b ✨ Final touches NikolajDanger 2023-05-27 18:48:11 +02:00
  • ee4739e9f2 Introduction of connectors NikolajDanger 2023-05-22 10:57:54 +02:00
  • d45ab051dd ✨ Small spelling fix NikolajDanger 2023-05-09 10:14:39 +02:00
  • 83ee6b2d55 ✨ Added previous work to new repo NikolajDanger 2023-05-06 21:06:53 +02:00
  • 933d568fb2 added time to all events. this is a unix timestamp so will need to be converted to something nicer if dispalyed, but hey, its easy to store PatchOfScotland 2023-04-27 15:13:47 +02:00
  • d3eb2dbf9f added standardised job creation PatchOfScotland 2023-04-22 21:48:33 +02:00
  • f306d8b6f2 updated runner structure so that handlers and conductors actually pull from queues in the runner. changes to logic in both are extensive, but most individual functinos are unaffected. I've also moved several functions that were part of individual monitor, handler and conductors to the base classes. PatchOfScotland 2023-04-20 17:08:06 +02:00
  • b87fd43cfd setup for rework of monitor/handler/conductor interactions PatchOfScotland 2023-04-18 16:24:08 +02:00
  • ddca1f6aa4 integrated threadsafe status updates PatchOfScotland 2023-04-18 13:50:20 +02:00
  • 3f28b11be9 added a proper version of job update protection PatchOfScotland 2023-04-14 16:15:36 +02:00
  • 9aa8217957 undid last commit as it would prevent anything ever being removed PatchOfScotland 2023-04-14 15:44:31 +02:00
  • 2bba56fdf8 updated status updating to merge in a more accomodating manner PatchOfScotland 2023-04-14 15:40:42 +02:00
  • c57198919b added functions to update job status files in a threadsafe manner PatchOfScotland 2023-04-14 15:28:27 +02:00
  • 547d5fefce refactored correctness dir away from core sub dir into either functionality or core as appropriate PatchOfScotland 2023-03-31 15:55:16 +02:00
  • 5952b02be4 added support for directory event matching PatchOfScotland 2023-03-31 13:51:14 +02:00
  • 14dec78756 condensed hint messages a bit PatchOfScotland 2023-03-31 12:55:29 +02:00
  • 6b532e8a70 added more hinting to pattern validation messages PatchOfScotland 2023-03-31 12:51:12 +02:00
  • cea7b9f010 removed rogue recipe script PatchOfScotland 2023-03-31 11:42:12 +02:00
  • 0c6977ecd3 standardised naming of test recipe scripts PatchOfScotland 2023-03-31 11:41:38 +02:00
  • 18d579da22 added tests for new bash jobs, and removed extra hash definition in job dict PatchOfScotland 2023-03-30 14:20:29 +02:00
  • 311c98f7f2 rewored rules to only invoke base rule, and added bash jobs PatchOfScotland 2023-03-30 11:33:15 +02:00
  • 747f2c316c added type hinting for new functions PatchOfScotland 2023-03-16 15:30:37 +01:00
  • 9bf62af31a added functions from runner to get monitor, handler and conductors PatchOfScotland 2023-03-16 14:50:04 +01:00
  • f1f16ca3b8 added naming to monitors, handlers and conductors so runners can identify them, in prep for in-workflow modification of patterns and recipes' PatchOfScotland 2023-03-16 13:53:01 +01:00
  • 9547df7612 added -s option to test to skip time consuming tests. also updated readme accordingly PatchOfScotland 2023-03-16 13:25:44 +01:00
  • a7f910ecff updated regex used in wildcard matching in file monitor to work on windows because why would things work on all systems PatchOfScotland 2023-03-15 15:16:38 +01:00
  • 23e9243b69 updated benchmarks ref in readme PatchOfScotland 2023-03-15 11:40:07 +01:00
  • 1f858e1a46 added note to readme about seperate benchmarking package PatchOfScotland 2023-03-15 11:21:32 +01:00
  • a7224430e9 moved benchmarking to its own meow_benchmarks package PatchOfScotland 2023-03-15 11:16:14 +01:00
  • ede29f3158 reformated imports for pep8 compatability PatchOfScotland 2023-03-14 15:12:22 +01:00
  • af489d2bb9 added test for get_recipe_from_notebook PatchOfScotland 2023-03-14 13:39:01 +01:00
  • 40ed98000b reformatted imports to work better on other machines, plus added benchmarking to project PatchOfScotland 2023-03-13 11:32:45 +01:00
  • c01df1b190 added test to check that adding pattern and recipe to monitor behaves correctly PatchOfScotland 2023-03-07 16:34:49 +01:00
  • 486c92f6da cleared up test_runner functionality_refactor PatchOfScotland 2023-02-24 10:38:02 +01:00
  • b9063e1743 added requirements file PatchOfScotland 2023-02-20 14:18:22 +01:00
  • 8e34a50891 added implemenation and test for module versioning PatchOfScotland 2023-02-15 00:41:39 +01:00
  • fcd897f2ff added requirement tests PatchOfScotland 2023-02-14 18:58:37 +01:00
  • 4d29ced83d added test for reqs structuring PatchOfScotland 2023-02-13 19:34:32 +01:00
  • 6d92ce9fdb added comment to parameter sweep function PatchOfScotland 2023-02-11 23:51:23 +01:00
  • 7dd654bb8c added a parameter sweep execution test PatchOfScotland 2023-02-11 23:27:03 +01:00
  • 59c352904b added helper function to create parameter sweep, plus appropriate test PatchOfScotland 2023-02-11 23:12:18 +01:00
  • 9b744e9afe resolved circular dependencies in validation by splitting meow off too PatchOfScotland 2023-02-10 18:40:15 +01:00
  • 89a0700e1d split up meow tests PatchOfScotland 2023-02-10 16:28:55 +01:00
  • 6fab2f7a10 also refactored core.meow into seperate files in hope that it'll help solve circular imports PatchOfScotland 2023-02-10 16:23:24 +01:00
  • b8885146fa added missing return call in new id generation funcs PatchOfScotland 2023-02-10 15:33:01 +01:00
  • 7059a7340d seperated out rule and job id generation PatchOfScotland 2023-02-10 15:09:51 +01:00
  • 908ecf9950 split up functionality tests into different classes per file PatchOfScotland 2023-02-10 15:00:04 +01:00
  • 7f8b4f3e32 split functionality file across new module as was getting too long on its own. All functions remian the same, but imports will need to be updated. PatchOfScotland 2023-02-10 14:46:46 +01:00
  • dfd83e28dc removed some rogue print statements PatchOfScotland 2023-02-10 11:05:44 +01:00
  • c0411c43a4 added tests for handlers and conductors validating events and jobs PatchOfScotland 2023-02-09 17:29:21 +01:00
  • abffeed9db added some more tests for job execution and ensured an error file is always produced but failed jobs PatchOfScotland 2023-02-09 16:10:10 +01:00
  • a2df62c693 reformted jobs being passed to conductors so they only get a job directory and have to read the definitions from the appropriate files PatchOfScotland 2023-02-09 15:22:26 +01:00
  • 1eb022f79e added comments to local python constructor PatchOfScotland 2023-02-09 09:36:22 +01:00
  • d0a824c80f cleaned up a few loose imports no longer needed and commented out code PatchOfScotland 2023-02-09 09:28:42 +01:00
  • d918a1bdc1 accomdated windows differing connection types in wait function PatchOfScotland 2023-02-08 15:44:26 +01:00
  • d9df9c3cb2 resolved merge conflicts PatchOfScotland 2023-02-08 15:37:12 +01:00
  • a5191e351b Merge pull request #2 from toppggg/Windows1 Patch 2023-02-08 15:32:15 +01:00
  • ca10fd6dc7 Added line 89 assert again toppggg 2023-02-08 15:26:06 +01:00
  • 1e1b142849 Deleted print statements toppggg 2023-02-08 15:05:33 +01:00
  • 2899d44a00 Deleted print statements toppggg 2023-02-08 15:03:44 +01:00
  • a1451881ae updated code so should work on windows, with exception of waiting on multiple connections PatchOfScotland 2023-02-08 14:46:03 +01:00
  • 37d061b06a Added Pipeconnection for Windows and os.path.join, rather than hardcoded path combine toppggg 2023-02-08 14:32:16 +01:00
  • d787e37adc added a few more comments PatchOfScotland 2023-02-03 16:29:49 +01:00
  • d823b50fc9 added a very small readme PatchOfScotland 2023-02-03 16:24:54 +01:00
  • 9435d500db added a few more tests, most notably of python execution PatchOfScotland 2023-02-03 16:07:09 +01:00
  • bc7a043225 removed fake watchdog events as they were uncessary, and added a few more tests for good measure PatchOfScotland 2023-02-03 15:14:43 +01:00
  • 47f9fe73fa differentiated papermill and python jobs more clearly PatchOfScotland 2023-02-03 14:47:16 +01:00
  • 72d6b263b7 removed surplus imports PatchOfScotland 2023-02-03 10:50:18 +01:00
  • 1b638ec496 moved sweep definitions to base pattern PatchOfScotland 2023-02-03 10:47:51 +01:00
  • 64aaf46196 standardised event construction and validation a bit more PatchOfScotland 2023-02-02 17:41:18 +01:00
  • 636d70f4e8 added python handler, and reworked handler and conductor event/job discovery to be more modular PatchOfScotland 2023-02-01 17:43:16 +01:00
  • 5acb8c230e tidied up job creation a bit more PatchOfScotland 2023-02-01 15:04:06 +01:00
  • deb24f33ff updated conductor so it updates job meta files with statues PatchOfScotland 2023-02-01 11:25:03 +01:00
  • d08b8ce8c4 tidied up python job_func a bit PatchOfScotland 2023-01-31 18:06:36 +01:00
  • a2abf91e7e updated job creation to be written to files, which are then read and executed PatchOfScotland 2023-01-31 18:03:11 +01:00
  • bb7c4af1e5 added files missed from last commit PatchOfScotland 2023-01-31 17:18:03 +01:00
  • 64452e3f03 added support for multiple sweeps PatchOfScotland 2023-01-31 17:17:44 +01:00
  • 69cf90554d moved notebook declarations to tests/shared.py PatchOfScotland 2023-01-31 16:09:16 +01:00
  • c2330f23d3 added test directories to gitignore PatchOfScotland 2023-01-31 15:54:19 +01:00
  • f4c31b13df added cvery brief descriptions to tests PatchOfScotland 2023-01-31 15:49:29 +01:00
  • adfce30508 created shared file for some test fucntions PatchOfScotland 2023-01-31 14:52:03 +01:00
  • b95042c5ca added comments throughout PatchOfScotland 2023-01-31 14:36:38 +01:00
  • 31d06af5bf added rudimentary conductor for job execution PatchOfScotland 2023-01-26 13:47:17 +01:00
  • 75de8147be updated event dict to always include path, should be more future proof PatchOfScotland 2023-01-20 11:03:16 +01:00
  • 226bf7a7f9 updated event dict to always include path, should be more future proof PatchOfScotland 2023-01-16 14:41:06 +01:00
  • be2a9beff3 added interaction for monitor state updating PatchOfScotland 2023-01-15 13:44:53 +01:00
  • 6ab9c84745 added support for retroactive event recognition PatchOfScotland 2023-01-15 10:57:44 +01:00
  • eabedb4747 moved runner to own file as will be heavily expanded PatchOfScotland 2023-01-15 10:10:29 +01:00
  • ee81b2561e added support for multiple monitors and handlers PatchOfScotland 2023-01-13 18:53:02 +01:00
  • 2cd92c04fa some cleanup of unneeded imports and other small cleanups PatchOfScotland 2023-01-13 18:15:15 +01:00