1
0
Fork 0
mirror of synced 2024-09-27 14:51:28 +12:00
Commit graph

804 commits

Author SHA1 Message Date
Adria Navarro
6e7c78362e Return null instead of undefined 2023-05-02 12:46:53 +01:00
Adria Navarro
650cbc1f01 Handle cast as undefineds 2023-05-02 11:57:18 +01:00
Adria Navarro
c87cc39cea Add basic tests 2023-05-02 10:44:25 +01:00
Adria Navarro
29df12c247 Add csvutils 2023-05-02 10:34:45 +01:00
mike12345567
4f7e56fed9 Making build script into a module, so that it can be used in a specialised server build which also builds the thread scripts as required for worker-farm. 2023-04-27 19:00:01 +01:00
Michael Drury
9c93bf91c0 Merge pull request #10352 from Budibase/fix/10349
Allow SQL formulas using related row information to be used as display columns
2023-04-24 17:50:49 +01:00
mike12345567
1aca5d6407 Fixing an issue with creating relationships between existing tables, not using the correct type for the primary key in the foreign key relationship. 2023-04-19 17:17:37 +01:00
Michael Drury
42c37eea46 Merge pull request #10276 from Budibase/labday/automation-plugins
Automation step plugins
2023-04-18 17:33:25 +01:00
mike12345567
23e99ca4b7 Adding group and user tests for user sync. 2023-04-12 19:59:05 +01:00
mike12345567
ac37d00f69 Updating plugins to have a SDK, which can be used for automation action retrieval as well as datasources. 2023-04-11 16:37:26 +01:00
mike12345567
e699f4684a Updating the global user sync to be more accurate and also remove old user metadata from apps that users don't have access to anymore. 2023-04-04 18:03:56 +01:00
mike12345567
2e80bab7ad Removing requirement for built client library in component test case. 2023-03-31 17:13:25 +01:00
mike12345567
906d614c64 Merge branch 'merge-master-develop' of github.com:Budibase/budibase into merge-master-develop 2023-03-31 13:51:20 +01:00
Rory Powell
44aa19a99a Merge branch 'master' into merge-master-develop 2023-03-31 12:26:04 +01:00
Rory Powell
79bec7d86d Add force exit, -e flag and streaming to tests (#10151)
* Add force exit, -e flag and streaming to tests

* Temp remove script usage from worker tests

* Revert "Temp remove script usage from worker tests"

This reverts commit 5e0ed2e92d.

* Always fail test

* Ignore server test package from coverage report

* Unscope server only

* Run all server tests again

* Update backend core test script to fail when any command fails and force exit

* Don't try to require client in test

* Port memory limit fix from develop

* Remove always failing test and commented out block for client require

* Fixing some issues with test cases.

* Revert assertions in internalSearch.spec.js

---------

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
2023-03-31 10:32:13 +01:00
adrinr
8d45e44e2f Fix types 2023-03-30 11:30:35 +01:00
mike12345567
1c73b92595 Fix for app sync, base it on group roles, not just user roles - stops app sync from pulling in group users which do not actually have access to the app. 2023-03-21 13:55:28 +00:00
Rory Powell
e116941750 Rotatable secrets (#9982)
* Rotatable secrets

* Set new api encryption key var

* Lint

* Use fallback keys instead of array

* Point api encryption key to dedicated value

* Add API_ENCRYPTION_KEY to cli

* Lint + add api encryption key to env files
2023-03-13 15:02:59 +00:00
Peter Clement
1cb03c7603 fix roleId being undefined leading to groups override 2023-03-07 13:30:24 +00:00
Rory Powell
940de8b6a0 Run CI steps in parallel (#9760)
* Parallel CI

* Add build to integration test

* Add checkout to top of each run

* Revert branch update for ci job

* Experiment with --runInBand for CI

* Fix intermittent backend-core migration test failure

* Fix hanging worker redis connection

* Update naming from reset to newTenant
2023-02-21 17:13:24 +00:00
Adria Navarro
16e53957bc Merge branch 'develop' into feature/dependencies-image 2023-01-30 18:54:05 +00:00
adrinr
d160430ac8 Start race condition 2023-01-30 18:51:22 +00:00
mike12345567
3659768c42 Merge branch 'develop' of github.com:Budibase/budibase into feature/environment-variables 2023-01-17 15:25:17 +00:00
Gerard Burns
48e1695318 JSON import changes (#9288)
* JSON import changes

* Fix lockfiles

* PR Feedback, fix tests

* fix tests

* pr feedback
2023-01-17 15:07:52 +00:00
Peter Clement
117aaed356 Merge remote-tracking branch 'origin/develop' into feature/environment-variables 2023-01-12 14:54:02 +00:00
Rory Powell
e5e767f18d Correlation id's and log context (#7232)
* Correlation id's and log context

* fix build

* Remove redundant fields from LoggingProcessor.ts

* Only log correlation id when present e.g. this is not present on startup / shutdown / automations
2023-01-11 20:39:33 +00:00
mike12345567
d27674de5c Replacing some require statements with imports. 2023-01-11 19:07:01 +00:00
Rory Powell
fba7ef26ad Replace ts-jest with swc/jest (#9289)
- Add swc dependencies
- Add transform change to jest.config.ts
- Replace `export =` with `export default` in src code to enable code coverage to work with swc transformer
- Restructure backend-core errors package to allow for exporting error classes with ESM syntax
- Update backend-core to no longer use `export =`, export individual packages instead of replacing with `export default` for backwards compatibility
- Update event publishers to use `export default` - this was required for the `jest.spyOn` usage inside backend-core common mocks
- Restructure some jest.mock usages where declaring the jest.fn as a variable outside of the package mock threw an error
2023-01-11 09:37:37 +00:00
Rory Powell
786039055e File authentication using presigned URLs (#8883)
* file auth wip

* Private plugin bucket wip

* Add etag to logo request, fix circular dependency

* Resolve cyclic dependency

* Ensure browser doesn't cache custom component

* Global file fixes

* File fixes / remove permaUrl

* Add ctx local storage

* Enable presigned url to work from any host

* Test fix

* Self hosting w/ S3 + other fixes

* Fix for serving dev app in multi tenant

* Fix backup restore and import attachment url processing, never store attachment urls

* Test fixes

* Unit tests WIP

* Replace file path with base64 encoded private key

* Multi tenancy tests for files

* Environment files fixes

* Post-merge build and test fixes

* Add debug conditional to all jest logging and revert/fix prod minio proxy_pass

* Re-add default '/' minio route :(

* Rename iconFile -> iconFileName

* Add cloudfront vars to k8s templates

* Remove public bucket policy

* Remove duplicated test
2022-12-15 11:35:22 +00:00
Peter Clement
9d841bc947 Server and Worker tests (#8928)
* automation unit tests

* row processor tests

* update executeQuery test

* update groups assertion

* some more worker tests

* plugin tests and tidying up

* linting

* temporarily disable group tests

* more tests

* fix import

* fix backup tests

* add pro mocks to worker

* check for app existence in import test

* test new tsconfig

* testing changes

* Pro test utils (#9020)

* Pro test utils changes

* Add test fixes

* Remove ts-ignore

Co-authored-by: mike12345567 <me@michaeldrury.co.uk>
Co-authored-by: Rory Powell <rory.codes@gmail.com>
2022-12-12 22:02:32 +00:00
mike12345567
b9ce140d95 Fix for #7732 - as well as some tests for it, make sure that it is working as expected. 2022-12-06 17:20:26 +00:00
Michael Drury
a656c6e678 Adding test case for char encoding and being explicit about utf8 export. 2022-11-29 16:03:22 +00:00
Michael Drury
31fbc937b0 Removing old JS file. 2022-11-29 15:23:01 +00:00
Michael Drury
bcf2aadbaa Merge branch 'develop' of github.com:Budibase/budibase into fix/charset-encoding 2022-11-29 11:57:45 +00:00
mike12345567
12d6e60525 One file left in the server, some fixes after converting the internal row controller. 2022-11-26 15:42:53 +00:00
mike12345567
658f12281d Fixes based on server build so far. 2022-11-26 15:10:41 +00:00
mike12345567
a3bb2e0d77 Automation overhaul to Typescript, plus type updates. 2022-11-25 19:57:07 +00:00
mike12345567
7eac8fafd6 Some server typescript re-writes, only automations left and some controllers. 2022-11-25 15:01:46 +00:00
mike12345567
514f9a1210 Some fixes based on test runs. 2022-11-23 11:44:15 +00:00
mike12345567
02ede5d067 Finally removing all usages of backend-core/ type imports from server, including some further typescript conversions. 2022-11-22 19:49:59 +00:00
mike12345567
8c2d9ebec8 Updating all of the route files to typescript, as well as some controllers. 2022-11-22 18:49:19 +00:00
mike12345567
8a4da7d4ce Typescript conversion of the table controllers. 2022-11-22 13:56:01 +00:00
mike12345567
4cdcafac36 More Typescript conversion, as part of backend-core importing improvements. 2022-11-22 12:41:36 +00:00
mike12345567
de82eca502 Some typescript conversions, moving a few imports around. 2022-11-21 18:33:34 +00:00
mike12345567
31c198888a Updating some enums, plural to single. 2022-11-17 14:59:18 +00:00
mike12345567
4328ed1b67 Updating middlewares to Typescript, as well as some fixes based on running tests. 2022-11-16 17:24:13 +00:00
mike12345567
535fab7997 Some major reworks towards higher levels of typescript. 2022-11-16 17:23:12 +00:00
mike12345567
5f658a0398 Converting further DB layers to TS - fixing mocks. 2022-11-15 18:33:24 +00:00
mike12345567
b5472f882b Some updates for currentapp.spec.js test case. 2022-11-15 17:35:17 +00:00
Rory Powell
998beddc30 Configurable CDN 2022-11-07 09:45:00 +00:00
mike12345567
11115aab56 Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-17 14:49:31 +01:00
Dean
7125e3f6e3 Merge remote-tracking branch 'origin/develop' into feature/qr-barcode-reader 2022-10-13 16:16:28 +01:00
mike12345567
9d34ccfaca Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-12 11:59:00 +01:00
Rory Powell
2f0f36e635 Merge branch 'master' into merge-master 2022-10-12 10:19:46 +01:00
mike12345567
19133f08e6 Adding import functionality - still need to update the attachments URL. 2022-10-11 20:25:22 +01:00
mike12345567
7c71f76b70 Export to tarball through tmp. 2022-10-11 18:21:58 +01:00
Rory Powell
ef4b1dd32b Fix user metadata update 2022-10-11 12:42:35 +01:00
mike12345567
1f36eec89a Some updates towards supporting attachments in app exports. 2022-10-10 20:08:59 +01:00
Dean
07be0208e5 Merge remote-tracking branch 'origin/develop' into feature/qr-barcode-reader 2022-10-10 09:08:48 +01:00
mike12345567
2d4eb10aba Merge branch 'develop' of github.com:Budibase/budibase into feature/app-backups 2022-10-07 20:48:28 +01:00
mike12345567
197d195cb4 Switching from scan for app locks to mget - which is a fast O(N) operation that only retrieves what we need. 2022-10-07 18:05:18 +01:00
Michael Drury
060b2aba3c Merge pull request #8175 from Budibase/fix/remove-app-scans
Removing Redis SCAN operation from app services
2022-10-07 17:35:05 +01:00
mike12345567
0c4a40c795 Switching from scan for app locks to mget - which is a fast O(N) operation that only retrieves what we need. 2022-10-07 16:05:01 +01:00
Dean
c09154b03e Renamed the 'Scanned Code' field type to 'Barcode/QR'. The component is also now listed as 'Barcode/QR Scanner'. Minor fix to include longform text columns in the table csv import list 2022-10-07 11:00:25 +01:00
mike12345567
ef52bde670 Building out initial SDK work - converting some existing exporting work to typescript. 2022-10-06 19:10:45 +01:00
mike12345567
ea2fb6de1b Merge branch 'master' of github.com:Budibase/budibase into develop 2022-10-06 16:54:25 +01:00
Dean
e251c914ff Review feedback changes. Changed 'Code' labelling to 'Scanned Code' 2022-10-06 13:02:17 +01:00
Dean
2ec21741d1 Initial commit of QR Reader field 2022-10-05 09:28:07 +01:00
Andrew Kingston
f2f842444a Update plugin URL utility export to use CJS syntax 2022-10-05 08:57:26 +01:00
Andrew Kingston
788dac0f8d Use CJS style imports in plugin URL helper to work in jest, and respect plugin bucket env var 2022-10-05 08:25:50 +01:00
Andrew Kingston
b487855348 Update plugin JS URL handling 2022-10-04 16:28:21 +01:00
Andrew Kingston
de9b2c44cb Add utility for generating plugin JS URLs 2022-10-04 16:27:04 +01:00
Rory Powell
79226777b1 Merge develop 2022-09-28 08:56:45 +01:00
Martin McKeaveney
c309d25b16 Merge pull request #7881 from Budibase/feature/email-cc
Add CC and BCC (with multiple email support) to Send Email automation action step
2022-09-25 13:40:33 +01:00
Michael Drury
c7fb092294 Fixing issue discovered by test. 2022-09-23 22:24:31 +01:00
mike12345567
e0b6ef66ac Fixing a few issues with roles being correctly reverted. 2022-09-23 17:45:26 +01:00
mike12345567
9b29bd6709 Merge branch 'develop' of github.com:Budibase/budibase into group-fixes 2022-09-22 18:44:16 +01:00
mike12345567
e3f054470a Updating a few core endpoints to better integrate the groups system and make sure users always have the correct role ID updated onto them. 2022-09-22 18:27:43 +01:00
Mel O'Hagan
1b49f02092 CC and BCC interface 2022-09-21 15:58:04 +01:00
Martin McKeaveney
9b5ed59f34 Merge pull request #7792 from Budibase/feature/plugin-pro
Plugin pro integration
2022-09-18 10:34:06 +01:00
mike12345567
6bad41e3ce Minor fix - datasource hot reloading was working apart from the the CJS require caching, need to clear down the cache entry before reloading. 2022-09-16 11:25:28 +01:00
Martin McKeaveney
c86bdffc52 Merge pull request #7646 from Budibase/qa/qa-core-jest
QA Core repo, and Jest API tests running end to end
2022-09-15 21:12:45 +01:00
mike12345567
40688f6783 Adding budibase/pro integration for plugins, controlling quota limits. 2022-09-15 14:57:27 +01:00
Rory Powell
0f98f2fcaa Merge branch 'master' into develop 2022-09-15 10:19:56 +01:00
Martin McKeaveney
ddc585fad3 Merge branch 'develop' into qa/qa-core-jest 2022-09-15 01:18:58 +01:00
mike12345567
416a2c999f Fixing issue with plugin import for datasources - extract the integration correctly. 2022-09-13 12:16:00 +01:00
mike12345567
722a087af5 Reverting organisation page changes. 2022-09-12 16:21:47 +01:00
mike12345567
828066de46 Merge branch 'develop' of github.com:Budibase/budibase into feature/plugin-management-ui 2022-09-12 15:34:34 +01:00
mike12345567
bbed4cce74 Fixing an intermettient test issue. 2022-09-12 15:16:31 +01:00
Rory Powell
45a43baee2 Merge branch 'master' into develop 2022-09-12 14:05:36 +01:00
mike12345567
3d66e71d7d Fixing an issue with deleting large apps with a lot of internal table data and adding back the export modal which allows picking whether an export includes internal table rows - #7583. 2022-09-09 20:06:29 +01:00
mike12345567
8e56a7a4d9 Fixing an issue with external tables containing time only fields. 2022-09-07 17:57:02 +01:00
NEOLPAR
c2bca8a025 uploading plugin for github, npm and url 2022-09-06 16:28:35 +01:00
Martin McKeaveney
c3f15b5af2 QA Core repo, and Jest API tests running end to end 2022-09-05 18:28:53 +01:00
NEOLPAR
4c47c3a418 sorting npm stuff out 2022-09-05 15:04:26 +01:00
NEOLPAR
7d8940f0cb Merge branch 'plugins-dev-experience' into feature/plugin-management-ui 2022-09-05 09:38:24 +01:00
mike12345567
a5f475872d Updating plugins to not think about versions, only ever one version of each plugin by name, making plugins self host only and adding error checking for datasource implementations. 2022-09-02 19:32:15 +01:00
NEOLPAR
54eed13541 create plugin github public and private 2022-09-01 20:04:45 +01:00
NEOLPAR
0e2a86460c uploading npm and url plugins 2022-08-31 16:09:47 +01:00
mike12345567
320cbfada3 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-31 15:53:32 +01:00
Rory Powell
5f022e04a3 Merge branch 'develop' into user-fixes 2022-08-31 11:39:41 +01:00
Rory Powell
435465f93a Update shutdown logging 2022-08-31 11:05:49 +01:00
NEOLPAR
e5446d2f8a plugin create npm 2022-08-30 21:37:08 +01:00
Martin McKeaveney
02c93071ee merge 2022-08-30 10:33:37 +01:00
Martin McKeaveney
4aa99336d7 adding path variable 2022-08-25 11:07:35 +01:00
Martin McKeaveney
d5c2f32df3 additional logging around component definitions 2022-08-25 10:57:30 +01:00
Andrew Kingston
975afc29d2 Merge branch 'plugins-dev-experience' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-22 11:27:18 +01:00
Andrew Kingston
23a91b89a7 Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-22 11:27:04 +01:00
Rory Powell
917bb96ae6 add on() to mock queue 2022-08-20 11:42:51 +01:00
mike12345567
f329f9868c Adding management of the new README.md file that is retrieved with the plugin skeletons. 2022-08-18 18:23:07 +01:00
mike12345567
2bb32253d8 Adding in hash handling for datasource plugins. 2022-08-18 15:21:55 +01:00
mike12345567
7dfe049ae6 Adding full builder integration of custom components - splitting into own section properly - fixing some issues with SVG class overlap. 2022-08-17 23:13:51 +01:00
mike12345567
b6a5ccbf10 Adding some controls around datasource config creation and updating minio fetch. 2022-08-17 11:01:25 +01:00
mike12345567
2aaff7576b Adding full flow for creating custom datasource. 2022-08-17 10:05:13 +01:00
Mel O'Hagan
5171fc09fb Delete attachments on field clear 2022-08-12 11:29:57 +01:00
mike12345567
76d427001a Merge branch 'develop' of github.com:Budibase/budibase into plugins-dev-experience 2022-08-11 16:34:01 +01:00
mike12345567
fc6111272e Fixing viewname enumeration. 2022-08-11 14:40:17 +01:00
mike12345567
b803a3fd93 Replacing all plural TS enumerations with singular - this involves a major rename of the DocumentTypes. 2022-08-11 13:50:05 +01:00
mike12345567
a683665a99 Adding plugin upload API - takes a file form-data and then extracts, uploads to minio and stores data about the plugin to CouchDB. 2022-08-10 20:01:48 +01:00
Martin McKeaveney
7de6117421 changing readstream let to const 2022-08-08 13:54:11 +01:00
Martin McKeaveney
9ec178c7c8 charset encoding 2022-08-08 13:51:02 +01:00
mike12345567
2dea5c5614 Some various session fixes based on current data. 2022-08-05 21:35:26 +01:00
Peter Clement
c3a4941119 Merge pull request #6989 from Budibase/pc/fixes
User Management UI fixes
2022-08-01 09:39:55 +01:00
Peter Clement
79f7fd380d pr comments and updating group check to be more safe 2022-07-30 11:38:08 +01:00
mike12345567
07f3897b55 Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-error-stop 2022-07-29 14:31:18 +01:00
Peter Clement
dca37a61da adding tests and pr comments 2022-07-27 10:20:39 +01:00
Peter Clement
548e8d518c Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-26 20:19:33 +01:00
Peter Clement
46a6fc5048 refactor groups into pro and some other pr comments 2022-07-26 20:04:29 +01:00
mike12345567
f4db17502a Merge branch 'develop' of github.com:Budibase/budibase into feature/automation-error-stop 2022-07-26 17:28:57 +01:00
mike12345567
3fad32899f Main body of updates to support disabling the cron, some cleanup of metadata at deployment to make sure they can be re-ran. 2022-07-25 20:45:29 +01:00
mike12345567
a84d4d014d Fixing issues with exporting apps, first removing the deleted documents when exporting and second making it so that the user has a choice whether to export the development app or the published app from the UI. 2022-07-22 18:16:14 +01:00
Peter Clement
dd34282a33 2nd fix for multi tenancy groups 2022-07-22 10:56:16 +01:00
Peter Clement
723bbd65e4 fixing bug on multi tenant environment 2022-07-22 10:12:16 +01:00
Peter Clement
ba74fa9500 update handling of group roles 2022-07-19 14:20:57 +01:00
Peter Clement
ca41e88045 Merge remote-tracking branch 'origin/develop' into feat/user-groups-tab 2022-07-19 11:23:31 +01:00
mike12345567
c525721854 Fix for #6709 - Adding the option to set a role for app action, allowing users to set what level an automation can be accessed from. 2022-07-15 17:13:45 +01:00
Peter Clement
f3fa67e802 split out id parsing into pro repo 2022-07-15 11:29:20 +01:00
Martin McKeaveney
367cf37795 remove beta stuff and remove self-host banners 2022-07-11 11:08:56 +01:00
Andrew Kingston
467cc27f47 Add env vars to automatically create initial admin user on first run 2022-06-30 11:28:52 +01:00
Martin McKeaveney
251520bcd1 adding types 2022-06-28 12:16:23 +01:00
Rory Powell
4dc5cfc5a7 Merge branch 'release' into merge-release 2022-06-13 11:45:18 +01:00
Martin McKeaveney
c470c2f676 merge with master 2022-06-08 13:26:14 +01:00
Andrew Kingston
72397530ec Apply timezones patch from existing ignore-timezones branch 2022-06-07 08:31:00 +01:00
Martin McKeaveney
d15dfb83fc new ui functionality working from S3 bucket 2022-06-06 23:30:36 +01:00
Peter Clement
5bd5d7df1b Merge pull request #6059 from Budibase/feat/dont-export-app-rows
Allow export of app without rows
2022-06-06 16:31:21 +01:00
Peter Clement
bd737cc1ca negate export button 2022-06-06 15:17:14 +01:00
Martin McKeaveney
d57c4987fe Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-01 09:47:13 +01:00
mike12345567
fa30457f2b Fixing issue with server not shutting down correctly when an error occurs, making sure that everything clears up gracefully. 2022-05-30 21:22:06 +01:00
mike12345567
723b96c5a5 Adding the ID inputs for the quota breakdown functionality. 2022-05-26 16:01:10 +01:00
Peter Clement
5a67be19fa Merge remote-tracking branch 'origin/develop' into feat/dont-export-app-rows 2022-05-26 10:32:18 +01:00