1
0
Fork 0
mirror of synced 2024-09-21 11:53:49 +12:00
Commit graph

216 commits

Author SHA1 Message Date
Martin McKeaveney
3265042025 Revert "Merge branch 'develop' into master"
This reverts commit 99adc2039b, reversing
changes made to fec20e526e.
2023-08-29 14:27:39 +01:00
mike12345567
7110351bdc Revert "revert develop into master"
This reverts commit fd099658a0.
2023-08-18 14:33:21 +01:00
mike12345567
e068e301ff Updating automation history tab to handle the stopped error status which can occur for CRONs. 2023-08-16 18:21:53 +01:00
mike12345567
2622fecd93 Quick fix. 2023-08-09 16:33:37 +01:00
mike12345567
63006e36d4 Adding the ability to disable an automation, as well making sure that automations have steps before running. 2023-08-09 16:24:57 +01:00
Michael Drury
2ea45e1351 Merge branch 'master' into log/automation-id-with-execution 2023-08-07 15:03:38 +01:00
Martin McKeaveney
b7810f915e fix lint 2023-08-07 12:55:28 +01:00
Martin McKeaveney
14785ca49d move to info log line 2023-08-07 12:36:19 +01:00
Martin McKeaveney
ac5ce13f80 debug log for automation ID 2023-08-07 10:59:42 +01:00
Adria Navarro
2698e47ec4 Type internal db.get 2023-07-18 11:41:51 +02:00
Michael Drury
67588f1051 Adding a JSON parse incase the input is actually an array in the form of a string (HBS). 2023-06-01 12:14:34 +01:00
Peter Clement
c6d0da33f4 add import for performance lib 2023-05-31 11:33:52 +01:00
Peter Clement
162ea5d969 update log formatting 2023-05-31 10:51:54 +01:00
Peter Clement
702c908ae8 remove logging 2023-05-31 09:42:44 +01:00
Rory Powell
a1dbd67535 Remove debug log 2023-05-30 19:23:19 +01:00
Rory Powell
b0783d373a Lint 2023-05-30 19:16:36 +01:00
Peter Clement
ef9fc94728 Merge branch 'fix/looping-performance-bug' of github.com:Budibase/budibase into fix/looping-performance-bug 2023-05-30 16:52:34 +01:00
Peter Clement
ed6cd8144b lint 2023-05-30 16:52:22 +01:00
Rory Powell
207512396a Merge pull request #10738 from Budibase/automation-investigation
Automation investigation logging + max doc size fix for automation log
2023-05-30 16:45:27 +01:00
Rory Powell
6230e62b9b Automation investigation logging + max doc size fix for automation log 2023-05-30 16:37:39 +01:00
Peter Clement
3119ba5a8d remove log 2023-05-30 14:41:04 +01:00
Peter Clement
0a91e5bed1 update let to const 2023-05-30 14:26:49 +01:00
Peter Clement
5a7f0ba586 Fix performance issue with looping and context 2023-05-30 14:25:28 +01:00
Peter Clement
b0a32f03b4 remove log 2023-05-25 09:14:09 +01:00
Peter Clement
a9bb534cdf set flag in automation orchestrator 2023-05-24 14:41:58 +01:00
Peter Clement
d271bbdadb rename syncWebHooks to syncAutomations 2023-05-19 10:07:02 +01:00
Peter Clement
e1eda14204 move sync automations away from bull and call directly 2023-05-18 17:01:53 +01:00
Rory Powell
578b599428 Lint 2023-05-17 14:10:22 +01:00
Rory Powell
42f472b038 Type updates for automation jobs 2023-05-17 12:26:07 +01:00
mike12345567
0d7959f720 Fixing some un-identified listeners, queue messages not being correctly printed, also improving the mechanism for detecting if in the main thread or not. 2023-05-04 17:20:21 +01:00
Michael Drury
1c7c06e983 Bulk of the automation plugin system, supporting custom plugins. 2023-04-10 23:48:54 +01:00
Peter Clement
0a567a3302 add new status to handle no iterations during loop 2023-03-31 12:23:10 +01:00
mike12345567
3859a4159f Minor fix for automations, the wrong function had the environment variables being added to environment, this is very minor, it simply makes sure that environment variables are in context for the whole of the automation runner - e.g. if utilising many datasources each of them doesn't need to re-retrieve the environment variables, instead they will be available based on the env vars retrieved at the start of the execution. 2023-02-10 14:14:43 +00:00
Martin McKeaveney
d4a0e44b31 merge 2023-02-05 22:11:37 +00:00
Rory Powell
da2c809a09 Merge branch 'develop' into feature/environment-variables 2023-01-27 11:27:11 +00:00
mike12345567
fe7b632727 Quick updates for #8989 - this issue appeared to be fixed already but just adding a few extra bits of security to make sure that looping only occurs when valid data is found in the binding. 2023-01-24 19:09:36 +00:00
mike12345567
5e68a4d814 Minor updates to the context system and also adding env vars to automation context. 2023-01-16 16:47:59 +00:00
Martin McKeaveney
fbf8230a3d allow all user bindings in SQL queries (#9354) 2023-01-16 12:24:32 +00:00
mike12345567
fc5f6ca530 Adding the ability to store environment variables to context, to make them more easily available/re-usable, as well as exposing them to queries. 2023-01-13 19:53:46 +00:00
mike12345567
87cf52192d Small update to properly support environments with environment variables, making sure that datasources correctly select based on app ID. 2023-01-12 14:38:12 +00:00
mike12345567
d27674de5c Replacing some require statements with imports. 2023-01-11 19:07:01 +00:00
mike12345567
69b9af51ff Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-11 18:08:49 +00:00
mike12345567
03df57d077 Adding in basic implementation of variable usage, getting from pro and enriching through new datasource SDK. 2023-01-11 17:57:51 +00:00
Rory Powell
fba7ef26ad Replace ts-jest with swc/jest (#9289)
- Add swc dependencies
- Add transform change to jest.config.ts
- Replace `export =` with `export default` in src code to enable code coverage to work with swc transformer
- Restructure backend-core errors package to allow for exporting error classes with ESM syntax
- Update backend-core to no longer use `export =`, export individual packages instead of replacing with `export default` for backwards compatibility
- Update event publishers to use `export default` - this was required for the `jest.spyOn` usage inside backend-core common mocks
- Restructure some jest.mock usages where declaring the jest.fn as a variable outside of the package mock threw an error
2023-01-11 09:37:37 +00:00
Peter Clement
57a5d8505d assign wasLoopStep correctly 2023-01-05 12:16:45 +00:00
Peter Clement
90f3d28bb5 fix for looping issue wher output was incorrect 2023-01-05 10:52:50 +00:00
Peter Clement
9d841bc947 Server and Worker tests (#8928)
* automation unit tests

* row processor tests

* update executeQuery test

* update groups assertion

* some more worker tests

* plugin tests and tidying up

* linting

* temporarily disable group tests

* more tests

* fix import

* fix backup tests

* add pro mocks to worker

* check for app existence in import test

* test new tsconfig

* testing changes

* Pro test utils (#9020)

* Pro test utils changes

* Add test fixes

* Remove ts-ignore

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-12 22:02:32 +00:00
Michael Drury
4f4eb4da26 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-29 11:13:54 +00:00
mike12345567
658f12281d Fixes based on server build so far. 2022-11-26 15:10:41 +00:00
Dean
f4c027c25b User/Auth context now being passed to dynamic variable request updates 2022-11-24 10:16:05 +00:00
mike12345567
02ede5d067 Finally removing all usages of backend-core/ type imports from server, including some further typescript conversions. 2022-11-22 19:49:59 +00:00
mike12345567
5f658a0398 Converting further DB layers to TS - fixing mocks. 2022-11-15 18:33:24 +00:00
mike12345567
b702c7482a Fixes for cronjob stop - correctly handle this without stalled job handle. 2022-10-14 13:26:42 +01:00
Peter Clement
bd47c948c5 one more log 2022-10-05 10:01:11 +01:00
Peter Clement
f4c9fc6897 remove logs 2022-10-05 09:53:47 +01:00
Peter Clement
2f220d668b fix looping issues in automations 2022-10-05 09:20:59 +01:00
Rory Powell
45a43baee2 Merge branch 'master' into develop 2022-09-12 14:05:36 +01:00
mike12345567
86c8618e8f Fix for #7431 - reboot didn't work at all previously which is why apps couldn't be published with it enabled, this is now a self host only feature, I've removed the ability to enable a reboot cron in the Cloud and it will not run the lookup/execution. 2022-09-07 17:05:17 +01:00
mike12345567
320cbfada3 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-31 15:53:32 +01:00
Rory Powell
dd86875ea2 Update shutdown logging 2022-08-31 10:47:41 +01:00
Rory Powell
28cdb16e08 enable stalled job disabling 2022-08-20 11:02:22 +01:00
Rory Powell
f273a6f779 Add logging to all event listeners for automations + stalled handling stub 2022-08-19 23:14:19 +01:00
mike12345567
51e06a9c7a Adding custom datasources to UI. 2022-08-15 18:38:09 +01:00
mike12345567
b803a3fd93 Replacing all plural TS enumerations with singular - this involves a major rename of the DocumentTypes. 2022-08-11 13:50:05 +01:00
mike12345567
f4db17502a Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-error-stop 2022-07-26 17:28:57 +01:00
mike12345567
61f24fe03f Adding UI for displaying when the CRON job has been stopped and alert the user to next steps. 2022-07-26 13:59:22 +01:00
mike12345567
3fad32899f Main body of updates to support disabling the cron, some cleanup of metadata at deployment to make sure they can be re-ran. 2022-07-25 20:45:29 +01:00
Michael Drury
07de5faa2d Main bulk of logic around detecting cron recurring failure, still need to disable. 2022-07-20 22:38:06 +01:00
mike12345567
ff0c3e501f Converting main automation thread to typescript. 2022-07-20 19:05:54 +01:00
mike12345567
078cf9e95f Fixing an issue with automations being unable to access app databases due to new context stack up. 2022-07-18 17:38:58 +01:00
Peter Clement
688c69fce2 Ensure a binding exists before continuing with loop 2022-07-18 13:10:18 +01:00
Dean
d34739f459 Updated query tests to remove altered datasource. Updated messaging for refresh failure messaging 2022-07-08 11:19:41 +01:00
Dean
02c0b433bb Fixed issue where mutation was causing expression bindings to be lost. Request retries will now have them intact for re-enrichment 2022-07-08 09:29:16 +01:00
Dean
a59d0c7f31 Linting commit 2022-07-06 13:09:13 +01:00
Dean
084a469442 Surface refresh process error messaging 2022-07-06 13:03:25 +01:00
Dean
9fcedfa979 Properly invalidate the cached user ensuring up-to-date credentials are always used 2022-07-06 11:51:48 +01:00
Dean
4805f73cb5 Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-07-05 09:28:56 +01:00
deanhannigan
37ce29fa2d Merge pull request #6315 from Budibase/feature/current-user-rest-bindings
REST query bindings for Current User
2022-07-05 09:22:03 +01:00
Dean
b0daf30b4a Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-07-05 09:07:33 +01:00
Dean
1e6845d5cb Refresh the OAuth tokens automatically when making rest calls. Fix to remove the password from the api token authentication. 2022-07-03 21:13:15 +01:00
Dean
85e755fc7f Ignore authconfigs for datasources if they are empty 2022-07-03 18:55:44 +01:00
Dean
31b51e1ecf Fixes for datasource authentication parsing. Mapping UX updates 2022-07-01 17:27:24 +01:00
mike12345567
21a78d6fc8 Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-logs 2022-07-01 15:14:12 +01:00
Dean
ac1df878d4 Merge remote-tracking branch 'origin/develop' into feature/current-user-rest-bindings 2022-06-29 18:50:14 +01:00
Dean
705af49e5a Merge remote-tracking branch 'origin/develop' into sso-rest-requests 2022-06-29 09:17:18 +01:00
mike12345567
74261661f1 Updating filter/condition action to show a stopped status rather than error, updating everything else to be aware of this. 2022-06-28 17:02:24 +01:00
Peter Clement
fadd4292ad update handling of max iterations 2022-06-23 16:08:25 +01:00
Dean
5fd385ab30 Merge commit 2022-06-23 14:29:19 +01:00
Dean
42cd5e2c63 Fix to ignore global rest query headers when they are not configured. 2022-06-15 10:09:47 +01:00
Dean
d50a62fd37 Context binding for authenticated user in REST API querys. Includes fix for REST datasource UI 2022-06-14 10:14:05 +01:00
mike12345567
fe84c0f21c Adding pagination control to the API and to the frontend, as well as getting view working as expected, emitting different key combinations to be able to search by any pattern. 2022-06-01 22:39:51 +01:00
mike12345567
34759c7916 Adding real history to the history tab, getting storage to couch and retrieval + api working. 2022-06-01 16:01:06 +01:00
mike12345567
702f4057bd Progress towards using couchdb for automation logs, after testing redis and realising it won't work. 2022-05-31 19:52:35 +01:00
mike12345567
fa30457f2b Fixing issue with server not shutting down correctly when an error occurs, making sure that everything clears up gracefully. 2022-05-30 21:22:06 +01:00
Peter Clement
4c77cf2516 parse max iterations value correctly 2022-05-19 16:38:16 +01:00
mike12345567
637ce41b3f Fixing an issue where HBS statements couldn't be used for passing arrays through to a looping action in automations. 2022-05-11 11:29:33 +01:00
Peter Clement
a2b38adac3 remove log 2022-05-04 13:30:08 +01:00
Peter Clement
dea5e73317 account for objects in failure condition 2022-05-04 13:25:46 +01:00
Peter Clement
45fd19583c linting 2022-05-04 11:55:26 +01:00
Peter Clement
af9b9b6921 Some foreach block fixes 2022-05-04 10:24:28 +01:00