1
0
Fork 0
mirror of synced 2024-09-25 13:51:40 +12:00
Commit graph

1055 commits

Author SHA1 Message Date
Adria Navarro
b7688d3a06 Do not store empty arrays 2024-04-25 13:21:00 +02:00
Adria Navarro
35ba5b93b5 Validate single reference not being an array 2024-04-25 13:21:00 +02:00
Adria Navarro
53badf9263 Lint 2024-04-25 13:20:59 +02:00
Adria Navarro
b56c86e1b0 Lint 2024-04-25 13:20:59 +02:00
Adria Navarro
808aba0c34 Input processing 2024-04-25 13:20:59 +02:00
Adria Navarro
afdbf4cc42 Add BB_REFERENCE_SINGLE type 2024-04-25 13:20:59 +02:00
Peter Clement
a4c0328c53
REST file handling and SMTP automation block attachments (#13403)
* handle files in rest connector

* fetch presigned url and return

* further updates to handle files in rest connector

* remove unused important and fix extension bug

* wrong expiry param

* tests

* add const for temp bucket

* handle ttl on bucket

* more bucket ttl work

* split out fileresponse and xmlresponse into utils

* lint

* remove log

* fix tests

* some pr comments

* update function naming and lint

* adding back needed response for frontend

* use fsp

* handle different content-disposition and potential path traversal

* add test container for s3 / minio

* add test case for filename* and ascii filenames

* move tests into separate describe

* remove log

* up timeout

* switch to minio image instead of localstack

* use minio image instead of s3 for testing

* stream file upload instead

* use streamUpload and update signatures

* update bucketcreate return

* throw real error

* tidy up

* pro

* pro ref fix?

* pro fix

* pro fix?

* move minio test provider to backend-core

* update email builder to allow attachments

* testing for sending files via smtp

* use backend-core minio test container in server

* handle different types of url

* fix minio test provider

* test with container host

* lint

* try different hostname?

* Revert "try different hostname?"

This reverts commit cfefdb8ded.

* fix issue with fetching of signed url with test minio

* update autoamtion attachments to take filename and url

* fix tests

* pro ref

* fix parsing of url object

* pr comments and linting

* pro ref

* fix pro again

* fix pro

* account-portal

* fix null issue

* fix ref

* ref

* When sending a file attachment in email fetch it directly from our object store

* add more checks to ensure we're working with a signed url

* update test to account for direct object store read

* formatting

* fix time issues within test

* update bucket and path extraction to regex

* use const in regex

* pro

* Updating TTL handling in upload functions (#13539)

* Updating TTL handling in upload functions

* describe ttl type

* account for ttl creation in existing buckets and update types

* fix tests

* pro

* pro
2024-04-22 15:30:57 +00:00
Dean
9c7fed9eb8 Merge remote-tracking branch 'origin/master' into feature/signature-field-and-component 2024-04-11 15:06:59 +01:00
Martin McKeaveney
4a6e1b7192 fix all cases of lint rule 2024-04-10 17:39:12 +01:00
Adria Navarro
b42cc88180
Merge pull request #13407 from Budibase/BUDI-8122/attachment_cleanup
Handle singleattachment on AttachmentCleanup
2024-04-10 10:41:32 +02:00
Dean
8e62aa8945 Fixes for existing attachment tests and some coverage for signatures 2024-04-08 16:51:43 +01:00
Dean
9b276aa3c1 Add in signature field testing support. Some signature fixes 2024-04-08 12:18:05 +01:00
Dean
203d6484ea Merge remote-tracking branch 'origin/master' into feature/signature-field-and-component 2024-04-05 14:15:47 +01:00
Dean
1e5506b8c3 Full support for signature field type and some feedback changes 2024-04-05 12:50:09 +01:00
Adria Navarro
1bc555350a Lint 2024-04-04 21:09:15 +02:00
Adria Navarro
80dfef9c42 Test single attachment on outputProcessing 2024-04-04 21:07:44 +02:00
Adria Navarro
b2ab4e022e Handle singleattachment on AttachmentCleanup 2024-04-04 20:39:11 +02:00
Adria Navarro
a1a06b5d18 Fix import 2024-04-04 14:14:11 +02:00
Michael Drury
1cfe4da027
Revert "Single attachment column type" 2024-04-03 16:01:45 +01:00
Adria Navarro
7d0090a8e2 Fix import/export 2024-04-03 17:01:36 +02:00
Adria Navarro
a4c8fcb2ac Clean and populate url 2024-04-03 16:43:12 +02:00
Adria Navarro
a8c3011071 Rename FieldType.ATTACHMENT to FieldType.ATTACHMENTS 2024-04-03 12:54:20 +02:00
Dean
ee3462648d Merge remote-tracking branch 'origin/master' into feature/signature-field-and-component 2024-03-26 12:07:10 +00:00
Gerard Burns
d9033b2636
Un-revert Skeleton Loader PR (#13180)
* wip

* wip

* wip

* client versions init

* wip

* wip

* wip

* wip

* wip

* linting

* remove log

* comment client version script

* lint

* skeleton loader type fix

* fix types

* lint

* fix types again

* fix manifest not being served locally

* remove preinstalled old client version

* add constant for dev client version

* linting

* Dean PR Feedback

* linting

* pr feedback

* wip

* wip

* clientVersions empty array

* delete from git

* empty array again

* fix tests

* pr feedback

---------

Co-authored-by: Andrew Kingston <andrew@kingston.dev>
2024-03-25 16:39:42 +00:00
Dean
a773c167d5 Merge remote-tracking branch 'origin/master' into feature/signature-field-and-component 2024-03-22 15:26:23 +00:00
Dean
6b5938aef6 Merging 2024-03-22 15:26:05 +00:00
Adria Navarro
0859e79b1e Lint 2024-03-20 23:19:42 +01:00
Adria Navarro
0827cc6bda Type everywhere! 2024-03-20 19:33:39 +01:00
Sam Rose
217b39c232
Reenable no-unused-vars 2024-03-20 11:46:39 +00:00
Sam Rose
f1278312ab
Reenable no-case-declarations. 2024-03-19 15:58:25 +00:00
Sam Rose
1785f3af7e
Get lint passing. 2024-03-19 10:55:51 +00:00
Sam Rose
1f63f0bddf
Run auto fix. 2024-03-19 09:46:10 +00:00
Andrew Kingston
b6eab42c18 Merge branch 'cheeks-lab-day-binding-eval' of github.com:Budibase/budibase into cheeks-snippets-poc 2024-03-14 16:24:16 +00:00
Adria Navarro
625c1dda9f Improve tests 2024-03-13 16:54:39 +01:00
Adria Navarro
940ff5acd2 Fix table changes with empty attachments 2024-03-13 16:48:58 +01:00
Adria Navarro
0420734d97 Add failing test 2024-03-13 16:48:32 +01:00
Andrew Kingston
28d938ba3e Lint 2024-03-12 19:09:32 +00:00
Andrew Kingston
16ce5ac65e Update how snippets are fetched and enriched into context, because HBS helpers can't be async 2024-03-12 17:02:01 +00:00
Adria Navarro
1367cf3636 Use wrappers 2024-02-19 16:18:56 +01:00
melohagan
b563fb48c8
Error when deleting selected rows that have attachment (#13063)
* Deprecate selectedRowIds

* Delete selected rows table

* Add selectedRows to table block context

* update account-portal

* update account-portal

* Lowercase deprecated

* Make sure attachment fields are empty arrays not null

* unit test
2024-02-19 11:09:36 +00:00
Sam Rose
dd4ea4be95
Nothing to see here, carry on. 2024-02-15 16:44:19 +00:00
mike12345567
32815d8d9b Quick readability enhancement. 2024-02-15 16:28:59 +00:00
Sam Rose
c2c0108e4f
Fix build (again). 2024-02-15 16:12:47 +00:00
Sam Rose
d04416b7c7
Merge branch 'revert-13047-revert-13043-fix/updating-users-via-public-api' of github.com:budibase/budibase into type-worker-requests 2024-02-15 16:09:35 +00:00
Sam Rose
e4b0330866
Simplify the typing of workerRequests.ts 2024-02-15 15:49:30 +00:00
mike12345567
1f4a254ec5 Fix for integration test, make sure to carry auth headers over correctly. 2024-02-15 15:47:56 +00:00
Sam Rose
dde8f77877
Type workerRequests.ts 2024-02-15 14:48:47 +00:00
Michael Drury
36e1a20c03
Revert "Revert "Fix updating users via cross-service comms (public API)"" 2024-02-15 13:45:08 +00:00
Michael Drury
74957725dd
Revert "Fix updating users via cross-service comms (public API)" 2024-02-15 13:44:43 +00:00
mike12345567
05d19c92c7 Fixing bug found by test. 2024-02-15 12:59:41 +00:00
mike12345567
d3bb8b2fa4 There was an issue where extra headers were being carried over to the worker instance when performing cross-service comms - these headers were causing the request to be rejected without consideration. Cleaning up to only include the headers Budibase really cares about in request, let fetch work out the generic ones. 2024-02-15 12:49:39 +00:00
Adria Navarro
cc715b7722 Revert scriptRunner changes to use vm2 2024-02-09 16:37:37 +01:00
Adria Navarro
f7583b2431 Add options 2024-02-09 13:20:21 +01:00
Adria Navarro
10c59e1ff6 Remove events 2024-02-09 13:17:28 +01:00
Adria Navarro
32723d7121 Trace scriptRunner 2024-02-09 12:51:57 +01:00
Adria Navarro
790d8fcf09 Trace scriptRunner.execute 2024-02-09 12:41:00 +01:00
Adria Navarro
ce483e8c12
Merge pull request #12964 from Budibase/fix-bson
Fix BSON usage for isolated-vm
2024-02-08 16:33:43 +01:00
Adria Navarro
1e101744de Make timeout per invocation more specific 2024-02-08 16:20:33 +01:00
Adria Navarro
a55e75ae18 Merge branch 'isolated-vm-wrapper' into fix-bson 2024-02-08 13:54:25 +01:00
Adria Navarro
57952131ac Replace # for privates 2024-02-08 13:44:07 +01:00
Adria Navarro
abe09509f0 Fix bson 2024-02-08 12:32:07 +01:00
Adria Navarro
d293abc8e8 Merge branch 'isolated-vm-wrapper' into fix-bson 2024-02-08 10:58:12 +01:00
Adria Navarro
7972f19cd1 Merge isolated-vm-wrapper 2024-02-08 10:45:00 +01:00
Adria Navarro
008b39abf4 Use wrapper for scripts 2024-02-08 09:38:09 +01:00
Adria Navarro
e4285e30f1 Use wrapper for queries 2024-02-08 09:38:09 +01:00
Adria Navarro
0ea7a515de Use bson library to parse to json 2024-02-07 16:14:56 +01:00
Adria Navarro
b8ebeff71c Add comments 2024-02-07 15:18:17 +01:00
Adria Navarro
6cafbbf036 Instantiate module 2024-02-07 13:47:43 +01:00
Adria Navarro
e2a1d8c880 Refactor 2024-02-07 10:58:43 +01:00
Adria Navarro
1ee20b0464 Fields as private 2024-02-07 10:58:43 +01:00
Adria Navarro
599860b558 Use bson only for mongo 2024-02-07 10:58:43 +01:00
Adria Navarro
0b0b6ddb13 Memory limit via env 2024-02-07 10:58:43 +01:00
Adria Navarro
7a9187d4dc Use new loadBundle function 2024-02-07 10:58:42 +01:00
Adria Navarro
a273276bd3 Use bson in isolated-vm 2024-02-07 10:58:42 +01:00
Adria Navarro
2c4601440f Merge branch 'master' into revert-12934-revert-12930-revert-12929-revert-12769-isolated-vm 2024-02-06 17:53:22 +01:00
Adria Navarro
75f8b40cc4 Clean code 2024-02-05 10:18:49 +01:00
melohagan
be0ff766f3
Chore/fix worker request error message (#12943)
* Revert "Surface email error (#12837)"

This reverts commit 2a24c85378.

* Improve workerRequest error handling

* update account portal

* Fix typing

* lint
2024-02-02 15:25:18 +00:00
Adria Navarro
8dfcc3aeb1
Revert "Revert "Migrate from vm to isolated-vm"" 2024-02-02 12:02:09 +01:00
Sam Rose
332a201ae7
Revert "Migrate from vm to isolated-vm" 2024-02-02 09:51:46 +00:00
mike12345567
6cad0e758f Quick fix for automation JS scripting, make sure context is passed through correctly. 2024-02-01 16:00:58 +00:00
Adria Navarro
181d462cdf Update uuid 2024-02-01 11:15:21 +01:00
Adria Navarro
623b4f5dab
Merge branch 'master' into isolated-vm 2024-01-31 10:47:08 +01:00
mike12345567
0eb29ef73f PR comments. 2024-01-24 18:00:32 +00:00
mike12345567
ccc751d09c A quick refactor to get rid of the old 'FieldTypes' enumeration, considering how core it is to all data handling in Budibase, the fact we had both 'FieldType' and 'FieldTypes' was confusing - righting this fully. 2024-01-24 16:58:13 +00:00
Adria Navarro
a65892d29b
Merge branch 'master' into isolated-vm 2024-01-23 17:32:54 +01:00
melohagan
2a24c85378
Surface email error (#12837) 2024-01-22 15:30:21 +00:00
Peter Clement
50078f4f0f Fix issue where flagClient could be undefined when running outside of test mode 2024-01-19 14:59:08 +00:00
Sam Rose
58abca62de
work in progress: replace vm2 and vm with isolated-vm 2024-01-05 13:48:20 +00:00
Sam Rose
642b75e0ae
Revert "Remove all custom tracing to see if it's the cause of the memory leak." 2024-01-02 11:36:32 +00:00
Sam Rose
3c0901f530
Remove all custom tracing to see if it's the cause of the memory leak. 2023-12-21 11:06:05 +00:00
Sam Rose
c4f124c78a
Update utils.ts
Co-authored-by: Adria Navarro <adria@budibase.com>
2023-12-15 12:22:37 +00:00
Sam Rose
7a11c5be92
Tweak newly added spans to track formula processing. 2023-12-15 11:10:23 +00:00
Sam Rose
a6f03b02f2
Use the right casing for DataDog 2023-12-14 17:27:22 +00:00
Sam Rose
899b6707e7
add the column into the processStringSync span 2023-12-14 17:10:09 +00:00
Sam Rose
0d3ea23301
Instrument formula processing in DataDog. 2023-12-14 16:52:47 +00:00
mike12345567
d4a4bb96f4 PR comments 2023-12-08 13:24:24 +00:00
mike12345567
f6d5db7d61 Adding test cases for attachment cleanup update. 2023-12-08 13:21:08 +00:00
mike12345567
7665d2fd53 Fix for attachment deletion when updating table column name, as well as refactoring to make the code a bit easier to follow. 2023-12-07 16:35:43 +00:00
mike12345567
936ce9fcc2 Adding test to make sure attachments are output correctly. 2023-12-06 12:29:37 +00:00
mike12345567
be6cb0825c Fixing an issue with import and images not displaying correctly. 2023-12-05 18:27:56 +00:00
melohagan
0e93717f1a
Allow null strings (#12298)
* Allow null strings

* Don't update null to blank

* Save empty as null

* Make blank string map to null

* Add mappings for BigInt

* Fix unit tests
2023-11-23 09:53:35 +00:00
Michael Drury
1d368be5de
Merge branch 'master' into fix/admin-user-backup 2023-11-22 10:59:45 +00:00
mike12345567
18a275ecb1 Removing unused function. 2023-11-21 17:44:46 +00:00
mike12345567
ddd8482013 Updating bb admin user creation so that it can be used incase in self host a user gets locked out, the environment variables can be used to create a simple user to access the system. 2023-11-21 17:30:11 +00:00
Adria Navarro
db2c20e3ae eslint import/newline-after-import 2023-11-20 21:52:29 +01:00
Adria Navarro
92f411bf77 Prettier 2023-11-20 21:48:49 +01:00
Adria Navarro
4d27ff1dc0 eslint import/no-duplicates 2023-11-20 21:48:49 +01:00
mike12345567
dde446286d Switching getMultiple to default to failure if not all entries found, then updating usages. 2023-11-09 17:08:14 +00:00
mike12345567
a26f2e83e4 Some of the new table getters did not account for table IDs not being found, adding a new function which properly accounts for IDs being missing and manages it correctly, rather than leaving tables in an undefined state. 2023-11-09 14:45:23 +00:00
mike12345567
4dc6b1eeda Merge branch 'master' of github.com:Budibase/budibase into fix/11972-external-relationship-formulas 2023-11-08 14:41:53 +00:00
Sam Rose
0633a3de65
WIP 2023-11-08 10:03:22 +00:00
Sam Rose
fdfda100c1
Ensure that the DB always returns Documents. 2023-11-07 18:14:52 +00:00
mike12345567
312415ca7d Enforcing squash for rows which contain circular structures. 2023-11-07 13:47:21 +00:00
mike12345567
49b00ee7ee Fixing build issue. 2023-11-07 11:07:25 +00:00
mike12345567
635af0f76a Getting external rows to be more consistent with the internal API - the formulas should be processed using the outputProcessing as they were being processed, but was causing an overwrite. The problem was that the external system internally processed the formulas/relationships, then squashed the relationships. Once it got to the external API, it would go through normal output processing, which would run over the squashed rows, causing an inconsistent behaviour. 2023-11-06 19:03:37 +00:00
Michael Drury
9643d9c0e2
Merge branch 'master' into feature/budi-7607-migrate-user-relationship-columns-to-the-new-user-column 2023-10-30 17:41:44 +00:00
Samuel-Martineau
674f40a06e
Fix how attachment URLs are handled 2023-10-30 11:12:16 -04:00
mike12345567
9b1a7bd854 PR comments - updating pickAPI to use a common function. 2023-10-27 11:43:01 +01:00
mike12345567
19eaafd946 Fixing some test cases. 2023-10-26 16:32:34 +01:00
mike12345567
ed0670a008 Major update to make the table.type always 'table' and then adding a new sourceType which states what source the table came from, external or internal. Don't want to keep using a type that should be static as two different things. 2023-10-26 13:19:09 +01:00
mike12345567
455b26bac9 Making sure the source ID is always set when creating a table - the frontend expects this to be set for every table so making the type represent this correctly. 2023-10-25 19:00:25 +01:00
mike12345567
13dadbcc7d Merge branch 'master' of github.com:Budibase/budibase into fix/internal-db-enrich-perf 2023-10-18 15:22:00 +01:00
Sam Rose
767900aec6
Remove type information from JSDoc in .ts files, it's redundant. 2023-10-17 16:46:32 +01:00
Michael Drury
a23f918880 Merge branch 'master' into fix/internal-db-enrich-perf 2023-10-12 11:09:17 +01:00
Adria Navarro
5908a791f2 Return email and names on bb reference api output 2023-10-11 19:10:58 +02:00
mike12345567
09ce950e64 Merge branch 'master' of github.com:Budibase/budibase into fix/internal-db-enrich-perf 2023-10-11 17:24:08 +01:00
Adria Navarro
62fd9011f3 Merge branch 'labday/type_schema' into feature/multi-user-type-column 2023-10-11 14:13:55 +02:00
Adria Navarro
715db97436 Clean code 2023-10-11 13:21:51 +02:00
Adria Navarro
9391854f46 Types 2023-10-11 13:21:19 +02:00
Adria Navarro
6fa5727166 Clean 2023-10-11 13:19:05 +02:00
Adria Navarro
f57104730e Remove subtype from the base field schema 2023-10-11 12:23:54 +02:00
Adria Navarro
a8c814e714 Fixes fixes 2023-10-10 18:54:57 +02:00
Adria Navarro
6c328109b6 Fixes 2023-10-10 18:54:57 +02:00
Adria Navarro
21e2d7ddbe Fix relationship types 2023-10-10 18:54:57 +02:00
Adria Navarro
c8ffa98844 Fixes 2023-10-10 18:54:57 +02:00
Adria Navarro
530857a6ff Fix 2023-10-10 15:39:05 +02:00
Adria Navarro
c49a16fdac Fix tests 2023-10-10 15:35:00 +02:00
Adria Navarro
21420c59fa Fix order 2023-10-10 14:39:55 +02:00
Adria Navarro
78335be26a Clean 2023-10-10 14:20:26 +02:00
Adria Navarro
d3e8e1f4f8 Fix importing 2023-10-10 13:52:47 +02:00
Adria Navarro
b966ed221d Fix bulk delete 2023-10-10 13:52:47 +02:00
Adria Navarro
fd414dbe4b Enable importing bbrefs as string csv 2023-10-10 13:52:47 +02:00
Adria Navarro
979c2aeb00 Return only id and primary display 2023-10-10 13:52:47 +02:00
Adria Navarro
df97b7ad93 Expect BB ref data as csv strings 2023-10-10 13:52:47 +02:00
Adria Navarro
f22467fa53 Validate user column 2023-10-10 13:52:47 +02:00
Adria Navarro
7d6cd53c29 Add comments 2023-10-09 15:37:42 +02:00
Adria Navarro
0909e0547e Process formulas after processing complex fields 2023-10-09 15:30:07 +02:00
Adria Navarro
047936bcbf Merge branch 'master' into budi-7589/user-column-multi-user-filtering-support 2023-10-09 09:22:55 +02:00
mike12345567
0dc28122fa Adding test case. 2023-10-06 16:38:36 +01:00
mike12345567
d4335bca73 Quick fix for saving current user._id - make sure it is the correct format of ID. 2023-10-06 16:31:48 +01:00