1
0
Fork 0
mirror of synced 2024-09-21 20:01:32 +12:00
Commit graph

980 commits

Author SHA1 Message Date
mike12345567
3228463749 Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2023-11-17 17:23:25 +00:00
Adria Navarro
d0e40afbcb Fix lint issues 2023-11-17 14:42:37 +01:00
mike12345567
20895cf426 Adding test case. 2023-11-09 18:22:06 +00:00
mike12345567
dde446286d Switching getMultiple to default to failure if not all entries found, then updating usages. 2023-11-09 17:08:14 +00:00
mike12345567
a26f2e83e4 Some of the new table getters did not account for table IDs not being found, adding a new function which properly accounts for IDs being missing and manages it correctly, rather than leaving tables in an undefined state. 2023-11-09 14:45:23 +00:00
mike12345567
4dc6b1eeda Merge branch 'master' of github.com:Budibase/budibase into fix/11972-external-relationship-formulas 2023-11-08 14:41:53 +00:00
mike12345567
e8fb43d30c Updating DesignDocument and View typing - making it more clear how view and lucene indexing works. 2023-11-08 12:46:00 +00:00
Sam Rose
57eb23dc50
Remove unnecessary type cast. 2023-11-08 09:24:51 +00:00
Michael Drury
18c417f02f
Merge branch 'master' into fix/11972-external-relationship-formulas 2023-11-07 18:35:43 +00:00
Sam Rose
fdfda100c1
Ensure that the DB always returns Documents. 2023-11-07 18:14:52 +00:00
mike12345567
fdae7ab913 Fixing issues discovered by tests. 2023-11-07 13:37:45 +00:00
mike12345567
635af0f76a Getting external rows to be more consistent with the internal API - the formulas should be processed using the outputProcessing as they were being processed, but was causing an overwrite. The problem was that the external system internally processed the formulas/relationships, then squashed the relationships. Once it got to the external API, it would go through normal output processing, which would run over the squashed rows, causing an inconsistent behaviour. 2023-11-06 19:03:37 +00:00
Dean
9bb9fb5549 Reintroduce filtering and sorting for exported row data 2023-11-06 17:00:47 +00:00
mike12345567
00f1d2cbdc Moving functions inside class. 2023-11-02 18:23:16 +00:00
mike12345567
a62d82afb8 Fixing user migration issue where relationships created from the other side (from user table) where not being migrated correctly. 2023-11-02 18:14:25 +00:00
mike12345567
15b1f3efe6 Removing duplicate filtering of automation logs. 2023-10-31 10:51:46 +00:00
mike12345567
2b96de3c30 Merge branch 'master' of github.com:Budibase/budibase into fix/backups-remove-automation-logs 2023-10-31 10:38:07 +00:00
mike12345567
41d99f6a58 Updating app backup exports to not include automation logs as these bloat the backups. 2023-10-30 17:41:08 +00:00
Sam Rose
45543cbc03
Catch a few more edge cases with column names, add tests for them. 2023-10-27 15:59:31 +01:00
Michael Drury
2bfdd9769e
Merge pull request #12177 from Budibase/feature/make-table-source-id-required
Make sourceId property of table required (for all table types)
2023-10-27 13:35:47 +01:00
mike12345567
9b1a7bd854 PR comments - updating pickAPI to use a common function. 2023-10-27 11:43:01 +01:00
mike12345567
d0f989597a Updating tests to be more consistent in how they pick to create an internal or external table. 2023-10-26 17:27:54 +01:00
Sam Rose
536d85d828
WIP: Improving the use of DatabaseQueryOpts. 2023-10-26 15:04:33 +01:00
mike12345567
ed0670a008 Major update to make the table.type always 'table' and then adding a new sourceType which states what source the table came from, external or internal. Don't want to keep using a type that should be static as two different things. 2023-10-26 13:19:09 +01:00
mike12345567
fd0d8f17f2 Making sure single table get also includes sourceId. 2023-10-25 19:07:51 +01:00
mike12345567
455b26bac9 Making sure the source ID is always set when creating a table - the frontend expects this to be set for every table so making the type represent this correctly. 2023-10-25 19:00:25 +01:00
Sam Rose
6c3b535863
Simplify try-catch in the migrate function. 2023-10-25 16:49:29 +01:00
Sam Rose
4a00649f7f
Simplify the function signature of processInternalTables 2023-10-25 16:46:14 +01:00
Sam Rose
70f39b6b6b
Fix missing sourceId on Table sent to the websocket. 2023-10-25 14:41:23 +01:00
Sam Rose
78afba63de
Emit table updates to the builder socket, and some minor refactoring. 2023-10-25 11:03:35 +01:00
Sam Rose
0f5c2cff00
Handle a couple more edge cases more gracefully. 2023-10-24 18:06:25 +01:00
Sam Rose
5e6ed0fd67
Implement many-to-one user column migration. 2023-10-23 11:54:27 +01:00
Sam Rose
febfab0927
Fix tests/types. 2023-10-23 10:48:10 +01:00
Sam Rose
86458dc321
Merge branch 'feature/budi-7607-migrate-user-relationship-columns-to-the-new-user-column' into feature/budi-7607-migrate-user-relationship-columns-to-the-new-user-column-2 2023-10-23 09:50:40 +01:00
Sam Rose
2d26597d07
Fix tests after merge. 2023-10-23 09:49:57 +01:00
Sam Rose
a563cf3594
Merge master. 2023-10-23 09:39:34 +01:00
mike12345567
fdfd58391a Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2023-10-19 18:25:11 +01:00
Sam Rose
a3ad8780de
Implement many-to-many user column migrations. 2023-10-19 17:28:55 +01:00
mike12345567
d1b551c6aa Type fixes. 2023-10-19 16:56:45 +01:00
mike12345567
470735cc97 Updating types across old table utilities. 2023-10-19 12:26:29 +01:00
mike12345567
f072a77d9f Updating throw. 2023-10-19 12:03:49 +01:00
mike12345567
54d976f750 Fixing PR comments. 2023-10-19 12:02:49 +01:00
Sam Rose
77729737bc
First test passes! 2023-10-19 09:47:50 +01:00
mike12345567
9bd67595ec Merge branch 'master' of github.com:Budibase/budibase into refactor/improve-table-sdk 2023-10-18 19:05:23 +01:00
mike12345567
25ad78a94e Adding utilities. 2023-10-18 18:58:27 +01:00
mike12345567
8d1163e50d Adding external SDK, updating external controllers. 2023-10-18 18:58:19 +01:00
mike12345567
6bfa9d407b Adding internal SDK, updating internal table controllers. 2023-10-18 18:57:52 +01:00
mike12345567
291a97a078 Moving getters. 2023-10-18 18:57:30 +01:00
mike12345567
35e6452ecb Adding basic structure for the external/internal SDK. 2023-10-18 18:57:19 +01:00
Sam Rose
6517150f32
Merge branch 'master' of github.com:Budibase/budibase into feature/budi-7607-migrate-user-relationship-columns-to-the-new-user-column 2023-10-18 18:05:18 +01:00
Sam Rose
1771b5905a
Most of the way to getting my first test passing. 2023-10-18 18:02:10 +01:00
Sam Rose
6ae5451fdf
Create failing test. 2023-10-18 16:56:55 +01:00
mike12345567
13dadbcc7d Merge branch 'master' of github.com:Budibase/budibase into fix/internal-db-enrich-perf 2023-10-18 15:22:00 +01:00
Sam Rose
c84abb3e86
Merge branch 'master' of github.com:Budibase/budibase into feature/budi-7607-migrate-user-relationship-columns-to-the-new-user-column 2023-10-18 15:15:06 +01:00
Sam Rose
c25de74e17
Action Michael's feedback about the structure of this feature. 2023-10-18 15:14:34 +01:00
Michael Drury
b98f313754
Merge branch 'master' into fix/improve-external-request-typing 2023-10-18 12:04:22 +01:00
mike12345567
68e8630d85 Improving the typing around the ExternalRequest object, which has implications throughout the row API and SDK, cleaning up where possible based on it. 2023-10-18 10:57:04 +01:00
Sam Rose
767900aec6
Remove type information from JSDoc in .ts files, it's redundant. 2023-10-17 16:46:32 +01:00
mike12345567
b267e4ca28 Merge branch 'master' of github.com:Budibase/budibase into labday/sqs 2023-10-17 14:53:09 +01:00
mike12345567
6a4877159d Quick fix to make sure that the important components of the app metadata are correctly updated - as well as adjusting the import modal to check if the export is encrypted. 2023-10-13 17:43:14 +01:00
mike12345567
09ce950e64 Merge branch 'master' of github.com:Budibase/budibase into fix/internal-db-enrich-perf 2023-10-11 17:24:08 +01:00
Adria Navarro
62fd9011f3 Merge branch 'labday/type_schema' into feature/multi-user-type-column 2023-10-11 14:13:55 +02:00
Adria Navarro
ea1c273de0 Clean 2023-10-11 13:18:04 +02:00
Adria Navarro
a8c814e714 Fixes fixes 2023-10-10 18:54:57 +02:00
Adria Navarro
1f1ebc82e5 Fix more types 2023-10-10 18:54:57 +02:00
Adria Navarro
6c328109b6 Fixes 2023-10-10 18:54:57 +02:00
Adria Navarro
ea86ded912 Fixes 2023-10-10 18:54:57 +02:00
Adria Navarro
dd373cd5e9 Fix types 2023-10-10 18:54:57 +02:00
Adria Navarro
d7aa23f740 Testing 2023-10-09 13:21:40 +02:00
Adria Navarro
a5477f14d2 Handle users on search input 2023-10-09 13:21:27 +02:00
mike12345567
bc17bc43fa Fixing issue brought up by some unit tests. 2023-10-06 13:32:12 +01:00
mike12345567
7acc164e12 Fix build. 2023-10-06 13:28:27 +01:00
mike12345567
017b522a3f Comment to explain function. 2023-10-06 12:56:55 +01:00
mike12345567
6e6c5bc776 Handle arrays and fix issue brought up by REST testcase. 2023-10-06 12:31:52 +01:00
mike12345567
dc50515bcc Adding negative test case and fixing build issue. 2023-10-06 12:16:37 +01:00
mike12345567
3de8c53166 Adding a mapping layer to search queries so that we can map search inputs based on the table schema if desired - primarily for the user column. 2023-10-06 11:57:11 +01:00
mike12345567
ee4a042204 Typing fixes - unsure why all of these came up suddenly. 2023-10-05 18:40:56 +01:00
mike12345567
3e2f9dfc4e Further enhancement, client library sends up the column it wants enriched and then we can ignore everything else, makes a big difference for enriching users (with a lot of relationships). 2023-10-05 18:23:18 +01:00
mike12345567
069fd33964 Some work towards improving performance of internal DB enrichment, there is a problem with cyclic enrichment due to the outputProcessing, need to decide how to handle formulas on enrichment. 2023-10-04 19:18:21 +01:00
mike12345567
1db95a3006 Merge branch 'develop' of github.com:Budibase/budibase into labday/sqs 2023-10-02 16:32:10 +01:00
Adria Navarro
5b5c0b31ff Fix link loading relationships on external ds+ 2023-09-28 15:54:53 +02:00
Adria Navarro
317da512a5 Fix tests 2023-09-28 10:00:25 +02:00
Adria Navarro
0cec026932 Datasource usage on tests 2023-09-28 10:00:25 +02:00
Adria Navarro
049a91debb Clean 2023-09-28 10:00:25 +02:00
Adria Navarro
bf975ac039 Fix tests 2023-09-28 10:00:25 +02:00
Adria Navarro
d0fcb5d7e6 Fix patch on external ds 2023-09-28 10:00:25 +02:00
Adria Navarro
81ca81222c Process bb_references on external 2023-09-28 10:00:25 +02:00
Adria Navarro
6487d76b1d Merge branch 'develop' into feature/user-column-type 2023-09-25 21:51:43 +02:00
Adria Navarro
79e693c89d Merge branch 'develop' into feature/user-column-type 2023-09-25 19:03:25 +02:00
mike12345567
98680f7895 Updating dual bulkDocs call, to handle the merging of similar documents. 2023-09-25 17:48:07 +01:00
mike12345567
3d143c28a9 Last PR comments. 2023-09-25 17:00:20 +01:00
mike12345567
4d1c749444 First PR comment. 2023-09-25 16:58:06 +01:00
mike12345567
61c12d88cf Final work to support app update process. 2023-09-20 16:43:50 +01:00
Adria Navarro
85be9d6ebd Lint 2023-09-20 12:45:26 +02:00
mike12345567
8e0cf1d087 Moving things around ready for implementation of temp db handle. 2023-09-19 18:38:44 +01:00
Adria Navarro
235799c07d Merge branch 'develop' into backmerge-20230919 2023-09-19 12:33:04 +02:00
Adria Navarro
3f7b615d10 Populate apps from groups while fetching apps 2023-09-18 17:58:07 +02:00
mike12345567
68f3197522 Moving test to where the functions are now. 2023-09-14 17:12:09 +01:00
mike12345567
8ca3f13a1c Quick re-jig based on test failure, seems the base sql.ts is depended on fairly heavily, importing the SDK can create a lot of cycles. 2023-09-14 16:53:36 +01:00
Adria Navarro
d248c7b6b8 Fix types 2023-09-13 15:26:29 +02:00
Adria Navarro
881ff02a7d Merge branch 'develop' into BUDI-7367/ds_plus_row_unittest 2023-09-13 14:49:17 +02:00
Adria Navarro
069b0d6161 Fix types 2023-09-13 10:31:39 +02:00
Peter Clement
0df9f821fe Merge remote-tracking branch 'origin/master' into fix/remove-developer-role-from-imports 2023-09-12 09:36:11 +01:00
Peter Clement
cee89b95b1 remove reference to premium plan 2023-09-12 09:34:11 +01:00
Adria Navarro
a3e9765555 Merge branch 'develop' into BUDI-7367/ds_plus_row_unittest 2023-09-12 09:20:00 +02:00
Martin McKeaveney
722c4e6d48 merge with master 2023-09-11 11:57:18 +01:00
Adria Navarro
4e69e51cca Fix autocolumns 2023-09-08 17:42:54 +02:00
Adria Navarro
1a7a1cdd1b Fix view test 2023-09-08 16:23:34 +02:00
Martin McKeaveney
ab5753273d fix for legacy custom roles 2023-09-07 18:50:07 +01:00
Adria Navarro
205d33f172 Clean cypress refs 2023-09-07 15:37:22 +02:00
Adria Navarro
cd8e667f39 Fix permission sdk usage on auth middleware 2023-09-06 00:23:19 +02:00
mike12345567
83875cd2d6 Merge branch 'develop' of github.com:Budibase/budibase into merge-master-develop 2023-09-05 12:29:27 +01:00
mike12345567
d096f359d7 Revert "Revert "Merge branch 'develop' into master""
This reverts commit 3265042025.
2023-09-05 12:28:56 +01:00
Adria Navarro
c5e061c9bf Fix types 2023-09-04 16:22:50 +02:00
Adria Navarro
d68d449f1f DRY 2023-09-04 12:11:59 +02:00
Adria Navarro
bb8aacd830 Improve messaging 2023-09-01 17:23:47 +02:00
Adria Navarro
0dc03abe5f Display dependant info 2023-09-01 17:03:33 +02:00
Rory Powell
64af549341 Revert "Merge pull request #11489 from Budibase/fix/automation-disable"
This reverts commit e6319cce67, reversing
changes made to 7c12280fe3.
2023-09-01 15:12:23 +01:00
Adria Navarro
5b7756936d Change api interfaces 2023-09-01 11:33:59 +02:00
Adria Navarro
466f1e6132 Display inherit option 2023-09-01 10:52:06 +02:00
Adria Navarro
5d870fb41a Rename 2023-09-01 09:50:55 +02:00
Adria Navarro
774ff745b6 Return role origin 2023-09-01 09:40:29 +02:00
Adria Navarro
a56712f4d7 Change shape 2023-08-31 13:01:17 +02:00
Adria Navarro
dcd8c3b289 Move permissions code to sdk 2023-08-31 10:36:17 +02:00
Adria Navarro
cefb57d78a Merge branch 'develop' into views-v2-frontend 2023-08-30 15:12:56 +02:00
Adria Navarro
8e4138f50d Lint 2023-08-29 18:32:18 +02:00
Adria Navarro
6f2aa32878 Implement external 2023-08-29 15:39:56 +02:00
Martin McKeaveney
3265042025 Revert "Merge branch 'develop' into master"
This reverts commit 99adc2039b, reversing
changes made to fec20e526e.
2023-08-29 14:27:39 +01:00
Adria Navarro
7e2ecc1b3a Split between internal and external views 2023-08-29 13:35:22 +02:00
Andrew Kingston
100c6450dc Update view tests 2023-08-25 15:50:29 +01:00
Andrew Kingston
a22fc8d208 Merge branch 'develop' of github.com:Budibase/budibase into views-v2-frontend 2023-08-24 12:07:23 +01:00
Adria Navarro
3e70369832 Use 2023-08-24 11:47:42 +02:00
Adria Navarro
664f257239 Implemment checks 2023-08-22 11:27:06 +03:00
Adria Navarro
54c285f71c Add basic sdk checks 2023-08-21 17:56:40 +03:00
mike12345567
7110351bdc Revert "revert develop into master"
This reverts commit fd099658a0.
2023-08-18 14:33:21 +01:00
mike12345567
e174211440 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-08-17 17:34:44 +01:00
melohagan
b57a8c1130 Move when filter empty option into filter drawer (#11262)
* Add when filter empty dropdown

* Add unit tests

* "fix" typescript issue

* Add empty filter check for external

* Add unit test

* Hide empty filter option for custom query

* Make onEmptyFilter optional

* Fix unit tests

* Remove onEmptyFilter automation input

* Remove unused var

* Refactor

* Fix path

* Fix type issue

* Fix types
2023-08-17 13:31:52 +01:00
Martin McKeaveney
fd099658a0 revert develop into master 2023-08-17 10:28:15 +01:00
Andrew Kingston
c115a87cd6 Add dedicated endpoint for fetching view definitions 2023-08-15 17:07:14 +01:00
mike12345567
4bbae677b2 Updating tests/search to handle no schema means no data, rather than all data. 2023-08-14 12:44:05 +01:00
mike12345567
3b7a5c0392 Mutate in middleware, don't update reference. 2023-08-14 11:44:10 +01:00
mike12345567
97e5fe37a1 Cloning table schema to avoid mutation. 2023-08-14 11:19:00 +01:00
mike12345567
672e370904 Default state of view is no data returned. 2023-08-11 16:01:53 +01:00
mike12345567
9e0964a5e3 Removing concept of columns and schemaUI, replacing with just schema as now the backend uses UI attributes. 2023-08-11 15:52:13 +01:00
mike12345567
584784edca Lint. 2023-08-11 14:58:09 +01:00
mike12345567
822a086666 Refactoring to make it so that visible: false columns are removed from views, and when returning view schema, all columns are enriched. 2023-08-11 14:57:53 +01:00
mike12345567
7be67bf603 Merge branch 'develop' of github.com:Budibase/budibase into views-v2-frontend 2023-08-11 14:39:12 +01:00
mike12345567
60af4029aa Merge branch 'develop' of github.com:Budibase/budibase into BUDI-7189/handle_tableschema_changes_on_views 2023-08-11 14:15:21 +01:00
mike12345567
a24e1809b6 Merge branch 'views-v2-frontend' of github.com:Budibase/budibase into views-v2-frontend 2023-08-11 13:16:56 +01:00
mike12345567
b4b52d9266 Merge branch 'develop' of github.com:Budibase/budibase into views-v2-frontend 2023-08-11 13:16:29 +01:00
Adria Navarro
f6838631b0 Merge branch 'develop' into master-backmerge-20230810 2023-08-10 15:32:00 +03:00
mike12345567
63006e36d4 Adding the ability to disable an automation, as well making sure that automations have steps before running. 2023-08-09 16:24:57 +01:00
Adria Navarro
4f27197cce Add extra tests 2023-08-09 16:28:17 +03:00
Adria Navarro
3bf794c6ba Handle renames 2023-08-09 16:25:05 +03:00
Adria Navarro
a843385e79 Remove .only 2023-08-09 13:43:55 +03:00
Adria Navarro
865238a827 SyncSchema and tests 2023-08-09 13:43:13 +03:00
mike12345567
5e37d981da Merge branch 'develop' of github.com:Budibase/budibase into feature/view-api-merge 2023-08-07 16:22:19 +01:00
Andrew Kingston
935c0006c6 Merge branch 'develop' of github.com:Budibase/budibase into views-v2-frontend 2023-08-07 14:42:22 +01:00
mike12345567
a1d85a831c Some quick modifications to allow the views to go through the standard row CRUD, the view search is still separate for now however this may change. 2023-08-04 16:58:40 +01:00
Adria Navarro
4d74a6615f Fix types 2023-08-04 18:22:33 +03:00
Andrew Kingston
938a5a445f Add multi dev collab for viewV2 definitions 2023-08-04 15:04:58 +01:00
Adria Navarro
d3470dfcb0 Fix imports 2023-08-04 12:00:25 +03:00
Adria Navarro
a91ce15c9b Move interface SearchParams to types 2023-08-03 05:14:50 +02:00
Andrew Kingston
858a0796bd Merge branch 'develop' of github.com:Budibase/budibase into views-v2-frontend 2023-08-02 14:50:40 +01:00
Adria Navarro
a3a1e29350 Handle undefineds 2023-08-02 13:37:36 +02:00
mike12345567
7871bedb25 Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7052 2023-08-01 15:27:38 +01:00
Andrew Kingston
bb810e14d7 Fix issue with order 0 being ignored 2023-08-01 14:24:06 +01:00
Andrew Kingston
cb78788bdb Merge branch 'develop' of github.com:Budibase/budibase into views-v2-frontend 2023-08-01 14:12:03 +01:00
Adria Navarro
67baa56cbf Skip flaky test 2023-08-01 14:40:47 +02:00
mike12345567
4e1aa4fbbd Final PR comment. 2023-08-01 12:33:59 +01:00
Adria Navarro
1b2ce184d9 Fix types 2023-07-31 17:22:10 +02:00
Adria Navarro
da6136a108 Enrich schema using the new data 2023-07-31 17:15:51 +02:00
Andrew Kingston
0c72d08763 Merge branch 'develop' of github.com:Budibase/budibase into views-v2-frontend 2023-07-31 08:43:11 +01:00
Andrew Kingston
8204935dfa Add ability to update views, create views with existing filters and sorting applied 2023-07-30 12:49:07 +01:00
mike12345567
8522cb94d3 Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7052 2023-07-28 17:10:43 +01:00
Adria Navarro
b9820f94e6 Import lodash modules 2023-07-28 17:11:48 +02:00
mike12345567
3798caf86d Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7052 2023-07-28 16:08:38 +01:00
mike12345567
d8f50f139e Frontend update for app builders, handling when in the builder portal and don't have any app access, as well as allowing viewing of apps from the portal. 2023-07-27 17:52:56 +01:00
Adria Navarro
2457bf1b37 Extract external getrow to sdk 2023-07-26 16:03:14 +02:00
mike12345567
43024e1a30 Merge branch 'develop' of github.com:Budibase/budibase into labday/sqs 2023-07-26 14:40:49 +01:00
mike12345567
8253ad0a2e Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7052 2023-07-26 14:24:29 +01:00
Adria Navarro
11f0569446 Move row.validate to the sdk 2023-07-26 14:12:58 +02:00
Adria Navarro
2c6725404f Types 2023-07-26 13:54:35 +02:00
Adria Navarro
aeeb69d80e Merge pull request #11352 from Budibase/BUDI-7189/return_default_row_data
Return default row data
2023-07-26 11:29:24 +01:00
Adria Navarro
17b394dba9 Increase timeouts 2023-07-26 12:12:32 +02:00
Adria Navarro
d07f840559 Increase timeouts 2023-07-25 22:15:45 +02:00
Adria Navarro
3ce92e8034 Implement and test external field selector 2023-07-25 19:48:46 +02:00
Adria Navarro
67f502579e Test schema 2023-07-25 19:48:46 +02:00
Adria Navarro
3c28d112b5 Add internal sdk tests 2023-07-25 19:48:46 +02:00
Adria Navarro
d93c99b947 Return data when schema is defined 2023-07-25 19:48:46 +02:00
Adria Navarro
29bc87a47f Update view endpoint 2023-07-25 15:33:49 +02:00
Adria Navarro
c9dc4006a1 Merge branch 'BUDI-7189-views-v2' into BUDI-7189/return_columns_based_on_schema 2023-07-24 16:47:46 +02:00
Adria Navarro
c870039416 Refactor plus selector 2023-07-24 16:29:49 +02:00
Adria Navarro
1cf4e6e85a Return full object from search 2023-07-24 16:13:15 +02:00
Adria Navarro
d1d86b6803 Filter on the sdk 2023-07-24 16:13:15 +02:00
Adria Navarro
c58b145afd Test sdks 2023-07-24 16:12:42 +02:00
Adria Navarro
d8b801e647 Remove wrong describe 2023-07-24 16:04:54 +02:00
Adria Navarro
77a004f19a Remove wrong describe 2023-07-24 16:02:59 +02:00
Adria Navarro
ff57b982f8 Move enrich view schemas to view sdk 2023-07-24 15:57:17 +02:00
Adria Navarro
dceb51a08d Skip table order if defined on view 2023-07-24 15:17:05 +02:00
Adria Navarro
8e904cea13 Set order to the tests 2023-07-24 15:17:05 +02:00
Adria Navarro
810bb41547 Add sdk tests 2023-07-24 15:17:04 +02:00
Adria Navarro
d2020fd6bc Move enrich views to sdk 2023-07-24 15:17:04 +02:00
Adria Navarro
3f2fa1a8dc Remove view endpoint 2023-07-24 15:17:04 +02:00
Adria Navarro
30138570d5 Typex 2023-07-24 15:17:04 +02:00
Adria Navarro
c747881d73 Allow selecting certain columns 2023-07-24 15:17:04 +02:00
Adria Navarro
f3f0ee0959 Return view schema endpoint 2023-07-24 15:17:04 +02:00
Adria Navarro
fbccec64c7 Renames 2023-07-24 15:15:44 +02:00
Adria Navarro
6d973ce99a Infer table on search 2023-07-24 15:15:44 +02:00
Adria Navarro
36b82681ff Remove tableid from remove view url 2023-07-24 15:15:44 +02:00
Adria Navarro
fc831db06b Store ids containing table info 2023-07-24 15:15:44 +02:00
Adria Navarro
ff3bbf6217 Allow ViewV2 types 2023-07-24 15:15:44 +02:00
Adria Navarro
ac0ae34808 Fix search 2023-07-24 15:15:44 +02:00
Adria Navarro
21e17053c6 Don't persist the view as doc 2023-07-24 15:15:44 +02:00
Adria Navarro
d6121d1504 Remove fetch view 2023-07-24 15:15:44 +02:00
Adria Navarro
76f89e10d3 Create/delete, save to table 2023-07-24 15:15:44 +02:00
Adria Navarro
b82876b147 Remove view fetch logic 2023-07-24 15:15:44 +02:00
Adria Navarro
582e0eb1dd Use types 2023-07-24 15:15:43 +02:00
Adria Navarro
b778921028 Test sorting 2023-07-24 15:15:43 +02:00
Adria Navarro
d981ad039d Typings 2023-07-24 15:15:43 +02:00
Adria Navarro
e71d883dfd Change status codes 2023-07-24 15:15:43 +02:00
Adria Navarro
160d949423 Catch 404s 2023-07-24 15:15:43 +02:00
Adria Navarro
8282fbb99b Type responses 2023-07-24 15:15:43 +02:00
Adria Navarro
4ca25ee065 Implement deletes 2023-07-24 15:15:43 +02:00
Adria Navarro
e2c1a549de Find by table 2023-07-24 15:15:43 +02:00
Adria Navarro
f395b79cac Fix fetch 2023-07-24 15:15:43 +02:00
Adria Navarro
4a5a3e2c33 Implement and test fetch 2023-07-24 15:15:43 +02:00
Adria Navarro
899c8a14fb Implement and test create 2023-07-24 15:15:43 +02:00
Adria Navarro
6ff5c23cd6 Add controller scaffolding for views v2 2023-07-24 15:15:43 +02:00
mike12345567
c185dd7dd0 Merge branch 'develop' of github.com:Budibase/budibase into labday/sqs 2023-07-21 18:41:48 +01:00
mike12345567
87d80e08f5 Merge branch 'develop' of github.com:Budibase/budibase into feature/BUDI-7052 2023-07-21 17:34:27 +01:00
mike12345567
bb032852e5 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-07-21 16:26:34 +01:00
mike12345567
7673673db2 Updating RelationshipTypes -> RelationshipType. 2023-07-21 12:57:47 +01:00
mike12345567
3abe5d4cb2 Frontend work to support logging in as an app builder - also making sure when a new app is created that the user is assigned app access to it. 2023-07-20 18:34:12 +01:00
mike12345567
40b4943766 Fix for dynamic variables being duplicated when creating new REST queries - also moved some stuff to backend SDK to make a bit re-usable, allowing backend to detect duplicate dynamic variables and error. 2023-07-20 13:07:19 +01:00
Adria Navarro
58c59eba5e Remove unused db usages 2023-07-18 12:00:02 +02:00
Adria Navarro
2698e47ec4 Type internal db.get 2023-07-18 11:41:51 +02:00
Andrew Kingston
d3ab2a31d0 Merge pull request #11186 from Budibase/app-list-improvements
Show all users editing an app in the app list
2023-07-18 08:12:50 +01:00
Adria Navarro
deb256a013 Refactor and clean export tests 2023-07-17 19:50:06 +02:00
Adria Navarro
07607c0fd2 Fix tests 2023-07-17 19:07:54 +02:00
Adria Navarro
ccb5143383 Remove context from search 2023-07-17 18:45:40 +02:00
Adria Navarro
90bf4655ea Remove ctx from export rows (search not implemented) 2023-07-17 15:57:12 +02:00
Andrew Kingston
1a8da1c0af Move app enrichment of user sessions to users SDK 2023-07-17 14:56:09 +01:00
Adria Navarro
1bd8bdf84c Clean ctx from fetchview 2023-07-17 15:29:41 +02:00
Adria Navarro
e7f1bcab9e Remove ctx from fetch 2023-07-17 14:16:12 +02:00
Adria Navarro
81c6eab05e Fix references 2023-07-17 12:19:20 +02:00
Adria Navarro
77b3547af7 Remove usercontroller dependency from internal 2023-07-17 12:19:20 +02:00
Adria Navarro
9fbad37218 Fix tests 2023-07-17 10:51:52 +02:00
Adria Navarro
d1b64bcd9c Moving files and functions 2023-07-14 17:09:34 +02:00
mike12345567
c1e9bc3c81 PR comments. 2023-07-04 11:59:56 +01:00
mike12345567
4e560a1f32 Adding warning back in for non-409 errors of user sync. 2023-07-03 16:00:33 +01:00
mike12345567
76bce0be1a Removing the alert log of failure, this isn't really an error scenario, as it'll automatically get updated as part of app syncs and if the sync is reran. 2023-07-03 15:28:42 +01:00
mike12345567
6495b55b9d Merge branch 'master' of github.com:Budibase/budibase into develop 2023-06-29 17:06:14 +01:00
mike12345567
4d2aa2a67b PR comments. 2023-06-27 12:45:00 +01:00
mike12345567
1d5bc39282 PR comments. 2023-06-27 12:24:50 +01:00
mike12345567
1c09913d33 Fix for foreign keys being unsettlable after update, breaking Postgres test. 2023-06-26 15:05:10 +01:00
mike12345567
e022da5bc8 Adding test case for foreign key autocolumn enrichment. 2023-06-23 18:31:02 +01:00
mike12345567
c2b4dec88f Fix to make foreign keys auto-columns when used in relationships as well as making sure that when fetching tables that they can be removed, using the old fetch mechanism (to be replaced, but needs to work for now). 2023-06-23 18:09:52 +01:00
mike12345567
3d3efadb37 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-06-23 15:19:49 +01:00
melohagan
0860a5b248 Exclude entities from datasource env processing (#11000) 2023-06-22 17:35:47 +01:00
Rory Powell
5f716a62a4 Revert "Merge branch 'develop' into master"
This reverts commit 67fb9de7f4, reversing
changes made to ebec885b0a.
2023-06-16 10:13:43 +01:00
Jonny McCullagh
757ca6a166 Merge master develop (#10897)
* Binding drawer fixes

* Added missing headless flag for the bindable combobox

* Fix for QueryEditor width

* Fix svelte transitions in grid new row component breaking routify

* Bump version to 2.7.7

* fix REST connector failure to save

* Bump version to 2.7.8

* Bump version to 2.7.9

* Unexpected token when export data (#10721)

* Tidy ID string for JSON parse

* Display error for composite keys

* Unit test WIP

* directly assign the mock function on the datasource

* Unit tests for exportRows ID handling

---------

Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>

* Return all rows if oneOf value is falsey (#10638)

* Bump version to 2.7.10

* Make sure divider fields are left-most (#10627)

* Make sure divider fields are left most

* Refactor

* Bump version to 2.7.11

* Temporarily remove the focus store update as it triggers a full redraw of the component settings

* Linting

* Removed commented out code

* Bump version to 2.7.12

* Bump version to 2.7.13

* Do not show Business tag for Email action (#10867)

* Bump version to 2.7.14

* new deploy trigger (#10892)

* point the deploys at the new env

* Bump version to 2.7.15

---------

Co-authored-by: Dean <deanhannigan@gmail.com>
Co-authored-by: Andrew Kingston <andrew@kingston.dev>
Co-authored-by: Budibase Staging Release Bot <>
Co-authored-by: Martin McKeaveney <martinmckeaveney@gmail.com>
Co-authored-by: Martin McKeaveney <martin@budibase.com>
Co-authored-by: melohagan <101575380+melohagan@users.noreply.github.com>
Co-authored-by: Adria Navarro <adria@budibase.com>
2023-06-14 16:18:09 +01:00
Adria Navarro
4b065dda8b Fix exports/imports 2023-06-14 12:32:26 +01:00
Adria Navarro
a4f0b45d5e Fix merge 2023-06-14 11:17:32 +01:00
Adria Navarro
a9bf6967dc Merge branch 'budi-7010/export_controller_as_post' into budi-7010-encrypt-app-exports 2023-06-14 11:17:26 +01:00
Adria Navarro
551ca404b4 Decrypt file 2023-06-12 16:27:19 +01:00
Adria Navarro
1f4cdf348f Encrypt files 2023-06-12 11:49:38 +01:00
Adria Navarro
978591e2ba Enable encrypting 2023-06-09 16:26:48 +01:00
Adria Navarro
4acfc623b4 Use import for tar 2023-06-09 14:52:19 +01:00
mike12345567
9ee06e8e42 Updating fetch within main datasource UI to mimic that of the onboarding. 2023-06-07 18:34:32 +01:00
Rory Powell
abbd8c5c8b Merge branch 'master' into develop 2023-06-05 23:19:43 +01:00
mike12345567
651d50a064 Updating datasource information endpoint to POST which allows sending up an unfinished/unsaved datasource for fetching information with. Also changing how verification and information endpoints work so that enrichment is used and therefore env vars can also be used. 2023-05-31 17:04:29 +01:00
Peter Clement
f680fbd822 Merge remote-tracking branch 'origin/develop' into feature/sync-automations 2023-05-18 11:35:25 +01:00
mike12345567
cf7107d19a Updating sync to cover both prod and dev apps. 2023-05-17 19:35:00 +01:00
Adria Navarro
a21039d5b4 Fix auth checks when specified auth 2023-05-16 11:43:13 +02:00
Peter Clement
d43fc819c7 refactor check for collect step into sdk 2023-05-16 09:29:40 +01:00
Adria Navarro
99d525ad79 Move tests to qa-core 2023-05-15 13:16:56 +02:00
Adria Navarro
c3856a48aa Fix types 2023-05-15 13:16:56 +02:00
Adria Navarro
ffef2499cc Implement the check as part of the integration 2023-05-15 13:16:56 +02:00
Adria Navarro
b022dcba77 Types 2023-05-15 13:16:56 +02:00
Adria Navarro
25233c5c9b Add message response 2023-05-15 13:16:56 +02:00
Adria Navarro
f022a43065 Test pg connection 2023-05-15 13:16:56 +02:00
mike12345567
5363693ac3 Removing automation logs from app exports as they are not useful - they take up space and the imported app won't have ran any automations yet. I have added it as a flag so that this does not affect backups (as you would want to maintain logs for backups). 2023-04-27 11:36:52 +01:00
mike12345567
060dc05afa Removing export all apps functionality from cloud - this was a very niche feature and often confusing, now there is a consistent flow for starting out in self host. 2023-04-20 17:19:17 +01:00
Andrew Kingston
55ce83c444 Grid UI in data section (#10329)
* Add WIP spreadsheet

* Add footer and improve styles

* Refactor to use IDs and support changing text values inline

* Add inline editing of options fields

* Add row deletion and fix sizing

* Add ability to add new rows

* Fix z-index issue with option cells

* Remove deletion notification and fix selection

* Add gap between items in an options cell

* Tweak options cell to be pixel perfect

* Fix padding around sheet not working when scrolling

* Add resizable columns and add support for all themes

* Allow multiselect component and field to support text values

* Generate inclusion schema when importing multiselect columns

* Add support for multiselect type

* Add number cell

* Add functional date cell

* Disable editing autocolumns

* Make sticky column the primary display and fix opening options cells

* Improve display of relationship cell and options cell

* Support empty dates and use CSS variables for easier styling

* Use more CSS variables and add utils to spreadsheets

* Add drag and drop column reordering

* Break out reordering logic into new stores

* Rename reordering to reorder

* Break out other components from spreadsheet for cleaner code

* Break out spreadsheet body into its own component

* Split into more modular components and try virtual rendering

* Test absolute positioning

* Optimise virtual rendering for both columns and rows to handle infinitely large datasets

* Optimise scrolling and virtual rendering performance

* Fix columnn reordering

* Migrate sheet to data section, improve reordering and reszing

* Clean up more sheet state and increase performance

* Fix multiple issues with z-index, reordering and resizing

* Fix date cells in sheets

* Separate data fetching logic from main sheet and tidy up

* Add infinite scroll, improve row fetching, add error handling, fix svelte store updates

* Fix overly thin scrollbars in firefox

* Use nicer checkboxes and fix some hover styles

* Fix issue reordering columns in firefox and increase performance

* Tidy up

* Use search endpoint instead of get endpoint to fetch individual rows so that relationship enrichment occurs

* Tidy up

* Fix relationship issues when creating rows

* Optimise resetting data to smoothly transition when changing datasource

* Add WIP virtual dom implementation to massively increase performance

* Refactor spreadsheet into more discreet components

* Fix multiple issues, clean up rendering, improve performance

* Tune cell sizes

* Fix some scroll issues and add shadow to sticky column

* Fix issue when no primary display is set

* Add padding to sheet

* Improve styles

* Allow reordering columns to be the first column after sticky column

* Fix row hover state not being removed

* Update hovered row on wheel

* Update scroll styles and z-index

* Improve scroll logic and handle horizontal wheel events

* Simplify and improve z index styles

* Fix styles when using no sticky columns

* Improve rendering performance

* Improve performance by removing keyed each blocks and fix reorder target styling

* Ensure scroll top is always properly reset and add config store

* Allow configuring selecting rows and adding rows

* Integrate sheet into data section better

* Add back in functional delete row button

* Refactor stores and make state more modular

* Lint and remove unused deps

* Remove add column button

* Fix options cells being unable to scroll

* Add WIP initial multi-user websocket implementation for sheets

* Add WIP multi-user UI for sheet interface

* Fix issues with not disconnecting users when swapping datasource and improve multi-user UI

* Update layout and remove logging

* WIP column popovers for dataspace sheets

* Add popovers to sheet column headers, improve mouse UX

* Tidy reordering stuff

* Refactor resizing logic into store and improve UX around hover events when resizing/reordering

* Add column sorting and reordering via popover

* Handle context menu events in header cells

* Fully integrates sheets with datasection and remove lots of old stuff

* Fix buttons being highlighted when filters are set

* Add flags for controlling editing and adding rows in sheets

* Count context menu clicks when considering the click outside handler

* Prevent adding rows to users table and remove log

* Expose loading state of sheet and improve column highlighting logic

* Small style updates

* Update delete button and allow horizontal scrolling

* Add context menu to sheets with deletion and duplication features

* Improve UX around selecting rows and cells

* Add basic keyboard interactions to dataspaces

* Improve keyboard navigation in sheets

* Remove unnecessary searching through large rows array

* Fix issue with deleting rows and fix relationship cells displaying undefined

* Improve loading state

* Update menu width

* Merge with new shared-core and moved lucene utils

* Improve rendering performance and simplify component props

* Remove new row component and improve mouse interactions

* Tidy up buttons above sheets and add FAB for adding rows

* Optimise sheet data loading and add sort button

* Update sorting and remove logs

* Add sheet button to control column visibilty, improve sorting, improve disabled states

* Fix bug with select placeholders and fix sorting loops causing endless refreshes

* Update filter button to look consistent and add double click to resize columns to default width

* Ensure all derived stores have default values

* Reset scrolling when datasource changes and fix wasted pagination calls

* Improve performance by removing searches through the full row array

* Add advanced key handling for spreadsheets and improve blur and focus UX

* Ensure the selected cell is always visible

* Add icons for all data types

* Add new long form text cell

* Add boolean cell

* Add ability to focus first cell via tab

* Add cells for formulae and JSON

* Remove console logs

* Add attachment cell

* Increase padding to account for attachment dropdown

* Prevent deleting autocolumns via keyboard

* Fix attachments overflowing

* Improve sort button, remove header more icons unless hovered and highlight sorted column

* Add functional relationship cell

* Improve relationship cell

* Fix race conditions and edge cases in relationship cell

* Update user avatar colours

* Improve preservation of column widths in sheets when making schema changes

* Remove redundant sheet schema context and fix issues with mutating table schema

* Disable websocket in sheets

* Rollback state changes when row saving fails

* Fix one-to-many relationships allowing selecting multiple rows on both sides

* Remove log

* Make sheet gutter width customisable

* Allow expanding rows using existing edit row modal

* Fix text cell not using full width

* Sort columns to put autocolumns last

* Add new footer for adding rows, improve store memoization, support inverting all data types

* Improve animations for adding rows and handle add row failure

* Ensure all sheet feature flags work as expected and fix multi row deletion

* Fix options ordering

* Fix add row button not appearing when horizontal scrollbar is hidden

* Fix selecting newly created rows

* Remove log and add notification when creating or editing columns

* Move new row component to top, automatically invert cell renderers when required

* Add resizable rows

* Fix overlapping long form text borders

* Fix scroll not working in new row

* Update new row component, fix z-index issues, improve UX

* Large refactors to row creation, naming and sheet APIs

* Refactor stores to fix dependency issues, use modals for adding rows, simplify sheet

* Fix resize overlays

* Add custom colors for drop shadows and blue-100 to all themes, fix sticky column shadow

* Increase horizontal padding when scrolling to a selected cell

* Add multiple validation improvements

* Add validation to duplicating rows

* Remove log

* Restore missing event handler

* Improve data fetch reset logic, fix issues with stale cache in spreadsheets

* Fix issue with cell colors, improve row API interactions to avoid relationship issues due to API response differences

* Fix filters not working

* Simplify logic for reordering and add new overlay. Simplify sheet cells

* Fix importing and exporting with sheets

* Fix reorder overlay z-index issue

* Fix issue when no display column exists

* Fix issue with display column not being able to be unset

* Add persitence to column size and order in sheets

* Improve sheet integration with data section and add horizontal cell inversion

* Fix double click resizing of sticky column

* Make column visibility persistent and refactor column updating

* Improve sheet loading states

* Add beta button to sheet, tidy up constants

* Work around table API inconsistencies to handle table schema updates

* Add additional reorder options and improve beta button

* Improve sorting

* Add copy and paste to spreadsheet and add immediate editing of cells without additional click

* Remove copy/paste rows, remove move to start/end, improve copy/paste for cell values

* Fix dependency ordering

* Refactor other sheet stores to improve dependency ordering

* Fix errors not showing in sticky column and clear cell value on backspace press

* Rewrite relationship cell and update default column widths

* Ensure dynamic row height is properly accounted for

* Update text cells, number cells, long form field cells and relationship cells to respect row height

* Fix row heights with sticky column

* Update JSON, boolean and date cells to respect row height

* Update attachment cell to respect row height

* Use unique background for focused cell

* Standardise shadows across cell types

* Persist row height as table metadata

* Improve a few design issues

* Clean up

* Fix relationship cells not being readonly

* Lint

* Fix icon padding in relationship picker

* Improve styles in relationship dropdown

* Update shadow

* Update relationship icons

* Update relationship icons

* Update error label max size and position

* Prevent using invalid data types as display columns

* Add menu option to edit rows in modal

* Prevent sheet handling key events sourcing from modals

* Standardise menu overlay shadow and add count to relationship cells when hovering

* Improve relationship cell performance

* Remove spellcheck from text fields

* Fix resize overlay handler height

* Fix reorder overlay height

* Remove unused code and change selected table faster in data section

* Fix table selection not working when on datasource page

* Improve sheet loading state

* Add rowHeight property to table types

* Restore builder middleware

* Remove any naming of dataspaces

* Lint

* Disable row import button for users table and add optional chaining to spreadsheetsocket invocations to fix tests

* Use unique user edit modal for editing users in sheets

* Add schemaOverrides prop to sheet and use it to customise user table schema

* Update number icon

* Fix primary display column not properly disabling certain menu options

* Merge

* Update beta button position slightly

* Update beta button text

* Fix HMR for custom plugins which was broken due to signed minio links

* Add maze link to grid

* Update koa <> socket.io integation to improve fake koa context and allow current app middleware

* Rename sheet to grid

* Fix menu postiion, fix copy and paste in menu not working

* Remove commented out usages of websocket emissions for grid
2023-04-20 15:56:24 +01:00
Michael Drury
42c37eea46 Merge pull request #10276 from Budibase/labday/automation-plugins
Automation step plugins
2023-04-18 17:33:25 +01:00
mike12345567
b4e6cbce7a Some final updates to get tests passing again, issue with publisher tenant ID being the 'unique' format which cannot actually be used. 2023-04-17 15:59:59 +01:00
Michael Drury
ef5bcc4b66 Main body of PR comments, switching event handling to be a publisher of async events, a generic event; then adding a new async document update processor, which can later be converted to be part of the event processing pipeline. 2023-04-15 00:37:22 +01:00
mike12345567
f87974caf1 Removing duplicate test case. 2023-04-13 13:10:51 +01:00
mike12345567
8f8843aece Updating test cases based on new user sync and removing old endpoint testcases (endpoint removed). 2023-04-13 12:53:25 +01:00
mike12345567
b2d7f24ff3 Adding builder test case. 2023-04-12 20:02:37 +01:00
mike12345567
23e99ca4b7 Adding group and user tests for user sync. 2023-04-12 19:59:05 +01:00
mike12345567
e623820478 Adding test cases. 2023-04-11 17:33:52 +01:00
mike12345567
ac37d00f69 Updating plugins to have a SDK, which can be used for automation action retrieval as well as datasources. 2023-04-11 16:37:26 +01:00
Michael Drury
58d0a82108 First sync test, checking that a user is created correctly. 2023-04-05 22:35:01 +01:00
Michael Drury
0771ec55fb Small change to make sure no duplicates ever occur. 2023-04-05 21:22:50 +01:00
Michael Drury
70c9d06832 Adding group management to background user/group sync. 2023-04-05 20:51:47 +01:00
mike12345567
e699f4684a Updating the global user sync to be more accurate and also remove old user metadata from apps that users don't have access to anymore. 2023-04-04 18:03:56 +01:00
Michael Drury
ff98ba5a0a Adding a document update queue based on the events which can be used to track when certain documents have changed, using this for users and groups to detect when a re-sync is needed. 2023-04-04 00:25:15 +01:00
adrinr
4ca6982d27 Prevent double deletions 2023-03-31 11:25:51 +01:00
adrinr
8e8f4ac02d Add extra assertion 2023-03-30 15:16:45 +01:00
adrinr
2dd8b078e5 Test removing users from group 2023-03-30 15:14:16 +01:00
adrinr
b8fe9671b1 Rename test 2023-03-30 15:12:40 +01:00
adrinr
301ad598ad Test user group deletion 2023-03-29 17:05:32 +01:00
adrinr
efff31e181 Test user groups 2023-03-29 17:02:56 +01:00
adrinr
8783f0123d Add tests for admins vs app users 2023-03-29 16:42:31 +01:00
adrinr
b368c14308 Add unit tests to test new users 2023-03-29 16:18:32 +01:00
adrinr
e25429632b Remove users that should not be there anymore when syncGlobalUsers 2023-03-29 15:35:55 +01:00
mike12345567
1c73b92595 Fix for app sync, base it on group roles, not just user roles - stops app sync from pulling in group users which do not actually have access to the app. 2023-03-21 13:55:28 +00:00
mike12345567
5b150e7748 Removing migration change and fixing #9738 - making sure that exports with excludeRows enabled don't include attachments. 2023-03-01 19:43:40 +00:00
mike12345567
eba18a4159 Fix for #9739 - there was an issue with the mango syntax, when working with multi attachment columns it was using an AND comparator instead of OR, it should be searching for rows that contain any attachment column, not all attachment columns. 2023-03-01 19:01:13 +00:00
mike12345567
0c80ea2083 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-02-10 17:42:56 +00:00
mike12345567
4acfae6af6 Updating so that datasources always have correct types after environment variable enrichment. 2023-02-10 12:47:23 +00:00
mike12345567
0d21801ece Fix based on testing. 2023-02-08 19:44:17 +00:00
mike12345567
68912f8030 Minor fix for the plugin datasource error that occurred when opening apps in an environment where the datasource no longer exists. 2023-02-08 19:17:15 +00:00
mike12345567
4d86df057b Some fixes for #8770 - the CLI was very memory intensive when working with large databases, that contained many revisions. We don't need the revisions for app exports/backups, therefore I've updated our export systems to drop the revision history as it compacts the database significantly and speeds up exports/reduces memory usage. 2023-02-06 17:54:40 +00:00
mike12345567
c2eb8fb976 Update to cover the authentication for REST, replacing it with secret value and converting to password field, as well as minor update to env dropdown to only be a password field when not containing an environment variable - #9480. 2023-01-30 18:50:35 +00:00
mike12345567
ec719b251c Adding test case for secret-value replacement, to confirm that datasources API correctly replaces secret values with the actual secret. 2023-01-27 18:27:03 +00:00
mike12345567
fec16e23a0 Fixes for tests, allow any handlebars for datasources (dynamic vars). 2023-01-27 18:06:39 +00:00
mike12345567
3a40a64d15 Updating datasources to use new onlyFound option. 2023-01-27 15:21:04 +00:00
mike12345567
d667276fa1 Adding a onlyFound option to our handlebars system so that we can enrich only the parts we have and leave other components for further enrichment. 2023-01-27 15:15:07 +00:00
mike12345567
6349b08888 Don't check whether or not a datasource uses env vars when the function specifically includes the env vars, always fetch them so that they can be returned and put into context for queries to use. 2023-01-24 18:56:19 +00:00
Peter Clement
22e1c1cccf ensure object is passed to processObjectSync 2023-01-24 15:44:34 +00:00
mike12345567
f4d389797c Some minor updates after reviewing. 2023-01-19 19:10:41 +00:00
Mateus Badan de Pieri
eae7b529a7 adding validation for envvar bindings
adding validation for envvar bindings
2023-01-19 15:07:56 +00:00
mike12345567
b659060beb Updating datasource API to remove secrets when returning datasources. 2023-01-18 19:16:19 +00:00
mike12345567
5e68a4d814 Minor updates to the context system and also adding env vars to automation context. 2023-01-16 16:47:59 +00:00
mike12345567
fc5f6ca530 Adding the ability to store environment variables to context, to make them more easily available/re-usable, as well as exposing them to queries. 2023-01-13 19:53:46 +00:00
mike12345567
87cf52192d Small update to properly support environments with environment variables, making sure that datasources correctly select based on app ID. 2023-01-12 14:38:12 +00:00
mike12345567
03df57d077 Adding in basic implementation of variable usage, getting from pro and enriching through new datasource SDK. 2023-01-11 17:57:51 +00:00
mike12345567
f4f730aae2 Merge branch 'master' of github.com:Budibase/budibase into develop 2023-01-06 17:29:35 +00:00
mike12345567
76825c38b9 Adding test cases for the attachment re-write feature, mocking the direct couch find functionality. 2023-01-06 13:33:22 +00:00
mike12345567
cf90282303 Moving some stuff around to make more testable. 2023-01-06 12:47:12 +00:00
mike12345567
0c37c57a4b Fix for #9249 - there was an issue with the updating of attachment URLs when importing an app/backup, this resolves it by utilising pagination in the CouchDB find API, making sure to iterate through all documents when there is a larger number. 2023-01-05 18:03:36 +00:00
Rory Powell
786039055e File authentication using presigned URLs (#8883)
* file auth wip

* Private plugin bucket wip

* Add etag to logo request, fix circular dependency

* Resolve cyclic dependency

* Ensure browser doesn't cache custom component

* Global file fixes

* File fixes / remove permaUrl

* Add ctx local storage

* Enable presigned url to work from any host

* Test fix

* Self hosting w/ S3 + other fixes

* Fix for serving dev app in multi tenant

* Fix backup restore and import attachment url processing, never store attachment urls

* Test fixes

* Unit tests WIP

* Replace file path with base64 encoded private key

* Multi tenancy tests for files

* Environment files fixes

* Post-merge build and test fixes

* Add debug conditional to all jest logging and revert/fix prod minio proxy_pass

* Re-add default '/' minio route :(

* Rename iconFile -> iconFileName

* Add cloudfront vars to k8s templates

* Remove public bucket policy

* Remove duplicated test
2022-12-15 11:35:22 +00:00
mike12345567
a120ba0c8d Fixing repl options. 2022-12-07 18:22:02 +00:00
mike12345567
be0b15428b Linting. 2022-12-07 14:43:27 +00:00
mike12345567
617863ddd1 Fix for #7865 - if you deleted a cron automation immediately after creating/publishing it there was a scenario where prod automations would be out of sync with dev automations and it wouldn't really delete. To get around this, we do an automation sync back to dev DB - meaning that the cron ID is known and can be disabled. 2022-12-07 14:32:29 +00:00
mike12345567
dbde23a4de Fixes based on test failures. 2022-12-06 12:47:48 +00:00
mike12345567
2ba9088faa PR comments, moving more stuff into SDK. 2022-12-06 12:22:41 +00:00
mike12345567
53a6c0e74b Fix for #8896 - the automation logs were already being sync'd to the dev database, but when unpublished they are in-accessible. Some minor updates to make sure that before unpublishing there is a sync, and then most of the changes are in pro. 2022-12-05 18:24:25 +00:00
mike12345567
8f94664ddd Merge branch 'develop' of github.com:Budibase/budibase into refactor/backend-core-import 2022-11-22 12:03:31 +00:00
mike12345567
de82eca502 Some typescript conversions, moving a few imports around. 2022-11-21 18:33:34 +00:00
Dean
64e7239d42 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 15:40:11 +00:00
mike12345567
cfbed0b236 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-11-21 15:05:48 +00:00
Dean
02a902ebd3 Merge remote-tracking branch 'origin/develop' into feature/default-internal-datasource 2022-11-21 11:10:29 +00:00
mike12345567
58e59bfacc Updating PouchLike to be an interface in types, with its impl stored in backend-core, now called Database. 2022-11-17 14:35:03 +00:00
Dean
ff7a3b8cef Default Datasource and sample row data 2022-11-13 21:37:50 +00:00
Mel O'Hagan
6d1449431e Null pointer fix 2022-11-10 15:22:05 +00:00
mike12345567
c744d23832 Major update - removing the use of context for PouchDB instances, swapping knowledge of PouchDB to the PouchLike structure that replaces it. 2022-11-09 16:53:42 +00:00
mike12345567
eab9806ee3 Fixing an issue with some browsers sending the gzip type as x-gzip rather than gzip, which caused the processing to fail. 2022-10-27 19:14:31 +01:00
mike12345567
a24694a4ea Refactoring a lot of content around webhooks to Typescript, as well as fixing webhooks and automation app IDs on import of new app. 2022-10-25 18:19:18 +01:00
Rory Powell
9face50a07 Fix build failure around PouchDB type 2022-10-25 09:02:55 +01:00
Rory Powell
39c83d8fb1 Move backup processing into pro 2022-10-24 15:28:43 +01:00
mike12345567
fbed8923dc Moving statistics under backups sdk subfolder. 2022-10-24 10:14:35 +01:00
mike12345567
4daf9c2615 Addressing majority of PR comments. 2022-10-24 10:04:14 +01:00
mike12345567
e1dca87507 Fixing test case. 2022-10-21 18:52:39 +01:00
mike12345567
fe5d11232f Update with PR comments. 2022-10-21 18:25:35 +01:00
mike12345567
854cb23947 Getting the import system to carry out a backup of the app before the restore. 2022-10-20 19:07:10 +01:00
mike12345567
f11c0bbfd7 Some type updates and processor handling for backup document being created before backup/restore occurs. 2022-10-19 19:19:36 +01:00
mike12345567
10c81c1adc Fixing issue with using templates. 2022-10-19 16:57:14 +01:00
mike12345567
113a23ba3d Adding statistics output for backups. 2022-10-19 16:48:32 +01:00
mike12345567
59bf052b70 Fixing issue with metadata name not being provided for uploaded backup on publish. 2022-10-19 13:52:56 +01:00
mike12345567
f5845a8a6e Protection for real app IDs. 2022-10-19 11:47:07 +01:00
mike12345567
bdc4e29b2d Finishing import processor - download backup, delete dev DB and then import over the top of this. Also includes a rollback feature if the backup fails to restore for whatever reason. 2022-10-18 19:43:19 +01:00
mike12345567
b52f413aa5 Removing attachment dir constant - no longer needed. 2022-10-18 17:04:18 +01:00
mike12345567
caa4954d8e Updating export/import to include the budibase client and manifest. 2022-10-18 16:42:25 +01:00
mike12345567
f795cb0e33 Reformatting types to allow queue to be used for import and export. 2022-10-17 19:42:36 +01:00
mike12345567
1373630b33 Minor fixes after testing manual backup system. 2022-10-14 20:10:44 +01:00
mike12345567
0bd2a18e46 Main types and work for the CRUD operations of app backup backend in pro + the listeners to handle exporting apps from the server. 2022-10-14 19:24:03 +01:00
mike12345567
907b838db3 Fixing multi-app import from cloud. 2022-10-13 15:46:53 +01:00
mike12345567
d1c9a56e9a Full import implementation - needs further testing, untars the file with all apps, then adds each of them individually. 2022-10-12 19:15:28 +01:00
mike12345567
2eae3f2a6c Fixes for find functionality after testing. 2022-10-12 17:57:31 +01:00
mike12345567
f5dd87f8f9 Adding first pass of attachments updating. 2022-10-12 17:34:17 +01:00
mike12345567
8d7f40e443 Refactoring more to Typescript, adding the ability to use the _find API of CouchDB. 2022-10-12 17:02:23 +01:00
mike12345567
19133f08e6 Adding import functionality - still need to update the attachments URL. 2022-10-11 20:25:22 +01:00
mike12345567
f237befbce Some fixes + cleanup of tmp directory. 2022-10-11 19:28:13 +01:00
mike12345567
7c71f76b70 Export to tarball through tmp. 2022-10-11 18:21:58 +01:00
mike12345567
1f36eec89a Some updates towards supporting attachments in app exports. 2022-10-10 20:08:59 +01:00
mike12345567
ef52bde670 Building out initial SDK work - converting some existing exporting work to typescript. 2022-10-06 19:10:45 +01:00