1
0
Fork 0
mirror of synced 2024-10-01 09:38:55 +13:00
Commit graph

872 commits

Author SHA1 Message Date
Mel O'Hagan
e23d29b7ef lint 2022-08-08 21:57:36 +01:00
Mel O'Hagan
88f06539a4 Nested braces parse fix added for MongoDB 2022-08-08 21:56:55 +01:00
Mel O'Hagan
98d8080826 Bug fix findOneAndUpdate 2022-08-08 17:53:17 +01:00
Mel O'Hagan
d02e5ae87f Add unit tests for ObjectId 2022-08-08 17:01:56 +01:00
Mel O'Hagan
c57fc1cfcd Merge branch 'develop' into bug/sev2/mongodb-fixes 2022-08-08 15:15:03 +01:00
mike12345567
df074c6004 Fixing test cases. 2022-08-03 18:20:07 +01:00
mike12345567
5eeb2ea600 Updating the filter system to allow adding multiple filter properties of the same name at once, as well as enabling the use of the allOr property from within the UI - resolves an old issue #2585. 2022-08-02 18:34:58 +01:00
mike12345567
a99ed3bf52 Merge branch 'master' of github.com:Budibase/budibase into fix/6737 2022-08-01 19:00:17 +01:00
mike12345567
5aea08fdce Adding mechanism to allow displaying an error on data retrieval for tables. 2022-08-01 18:56:59 +01:00
mike12345567
41683c1f6d Fix for #6737 - making it so that if a column is deleted externally tables can be re-fetched and this will be fixed. 2022-08-01 17:40:35 +01:00
Mel O'Hagan
432a8eb1b7 Has any support SQL Server 2022-07-28 09:20:00 +01:00
Mel O'Hagan
600794de66 SQL Server containsAny unit test 2022-07-27 16:40:07 +01:00
Mel O'Hagan
9369498d38 Has any of filter Postgres 2022-07-27 16:37:29 +01:00
Mel O'Hagan
804d1ef8f6 Has any of MySQL filter 2022-07-27 13:19:47 +01:00
Mel O'Hagan
d9823faac6 Not Contains for SQL Server 2022-07-27 11:56:57 +01:00
Mel O'Hagan
54643cff58 Not Contains Postgres filter 2022-07-27 11:49:45 +01:00
Mel O'Hagan
8d7fe78028 Not Contains filter for MySQL 2022-07-27 11:40:46 +01:00
Mel O'Hagan
4135c4ce59 Fix unit tests 2022-07-26 16:58:01 +01:00
Mel O'Hagan
91f906877f Has all of SQLServer 2022-07-26 16:45:05 +01:00
Mel O'Hagan
3d263f3927 MySQL has all of 2022-07-26 16:16:46 +01:00
Mel O'Hagan
f436c50b5b Postgres has all of 2022-07-26 15:59:49 +01:00
Mel O'Hagan
0ead7fca54 lint 2022-07-26 11:38:34 +01:00
Mel O'Hagan
377aca0458 Support ObjectId in operator blocks 2022-07-26 10:53:53 +01:00
Mel O'Hagan
f653345296 Added unit tests for contains filter 2022-07-21 10:28:54 +01:00
Mel O'Hagan
6b81d3d727 Handle numeric types Postgres 2022-07-19 18:34:30 +01:00
Mel O'Hagan
cd0bac74e2 Prettier 2022-07-19 18:04:27 +01:00
Mel O'Hagan
e5dc38845b Added contains support for datasource pluses 2022-07-19 17:25:41 +01:00
mike12345567
2272c095b7 Fix for ARM processors. 2022-07-13 12:37:55 +01:00
Mel O'Hagan
65aab29ee6 Don't try to check externalType of related tables 2022-07-05 16:59:32 +01:00
Dean
4b296f9bce Merge remote-tracking branch 'origin/develop' into feature/current-user-rest-bindings 2022-06-29 18:50:14 +01:00
mike12345567
f0dd336b15 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-24 17:50:55 +01:00
Andrew Kingston
27d5f2ba6e
Merge pull request #6443 from Budibase/datasource-labels
Datasource labels
2022-06-23 15:32:28 +01:00
Mel O'Hagan
688a46f75e Added Knex.Raw to return type 2022-06-23 13:09:22 +01:00
Andrew Kingston
5dd8186383 Add types to datasources 2022-06-23 11:35:57 +01:00
Mel O'Hagan
1d6f780c72 Refactor - simplify regex and use enum 2022-06-23 09:41:43 +01:00
Mel O'Hagan
0fb46ca465 Only cast money as numeric for Postgres 2022-06-22 16:13:02 +01:00
Mel O'Hagan
bc72b63579 Use raw sql to get money type as numeric 2022-06-22 15:58:15 +01:00
Mel O'Hagan
ba0916d161 Added external types to ds+ schemas 2022-06-20 18:08:30 +01:00
Mel O'Hagan
78a3043aed Include external SQL server type in schema 2022-06-20 16:49:58 +01:00
Dean
3b68abf407 Merge remote-tracking branch 'origin/develop' into feature/current-user-rest-bindings 2022-06-20 09:09:21 +01:00
Mel O'Hagan
5f9944af34 Add empty options if missing for delete 2022-06-17 16:54:23 +01:00
Dean
18f2e13a30 Fixes for Rest API request UI. Rest test fixes for XML API request body. Fix for raw XML api request body parsing issue. General fixes for query testing. 2022-06-17 12:00:42 +01:00
mike12345567
a46d73931d Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-17 11:41:34 +01:00
Dean
57b8ae7842 Fix to ignore global rest query headers when they are not configured. 2022-06-15 10:09:47 +01:00
Rory Powell
05aca077d1 Merge branch 'release' into merge-release 2022-06-13 11:58:14 +01:00
Rory Powell
05f0393310 Merge branch 'release' into merge-release 2022-06-13 11:45:18 +01:00
Mel O'Hagan
9bb0dba973 Remove duplicate equals 2022-06-10 15:52:28 +01:00
Mel O'Hagan
86d0d37fd5 Fix for privatekey newline 2022-06-10 14:15:25 +01:00
Mel O'Hagan
aedda40891 Removed ServiceAccount to reduce confusion 2022-06-10 14:04:34 +01:00
Mel O'Hagan
91b97698a6 Rename Firebase to Firestore 2022-06-08 12:05:29 +01:00
Andrew Kingston
3a9e4fff87 Account for types being undefined when running in a test env 2022-06-07 08:41:45 +01:00
Andrew Kingston
f2e3b2efa8 Apply timezones patch from existing ignore-timezones branch 2022-06-07 08:31:00 +01:00
Martin McKeaveney
493607b853 update google sheets strategy to use the standard passport strategy 2022-06-05 16:43:04 +01:00
Mel O'Hagan
87c0df55f0 Using snowflake-promise 2022-06-01 11:41:41 +01:00
Mel O'Hagan
b282102998 Revert "Datasource plus - build schema"
This reverts commit 3c1d32ba24.
2022-06-01 09:36:42 +01:00
Mel O'Hagan
be8cd07cdc Revert "primaryKey name fix"
This reverts commit fcdc2bf584.
2022-06-01 09:36:28 +01:00
Mel O'Hagan
fcdc2bf584 primaryKey name fix 2022-05-31 14:47:27 +01:00
Mel O'Hagan
3c1d32ba24 Datasource plus - build schema 2022-05-31 14:39:53 +01:00
Mel O'Hagan
a940269051 CRUD added for snowflake 2022-05-31 13:10:16 +01:00
Mel O'Hagan
31aa9418dd Added types and error handling 2022-05-31 11:58:03 +01:00
Mel O'Hagan
a2a29caeea Added Snowflake integration 2022-05-30 21:13:45 +01:00
mike12345567
5f8cfcdb5c Opening connection for building schema. 2022-05-20 17:43:47 +01:00
mike12345567
a23e4efd8c Fix for Postgres connections, seemed to be some issues with out of order, connections not opening in time. 2022-05-20 17:41:27 +01:00
Mel O'Hagan
2c2eb69ae7 Improve parseQueryParams regex 2022-05-17 12:11:43 +01:00
Mel O'Hagan
aa0c09ac82 Parse params if needed 2022-05-16 22:44:38 +01:00
Mel O'Hagan
c6591490d3 Using mongodb types 2022-05-16 09:50:47 +01:00
Mel O'Hagan
6709eea7cc Removed unused aws Object import 2022-05-16 08:43:27 +01:00
Mel O'Hagan
bf144858bb Lowercase the object typo 2022-05-16 08:42:09 +01:00
Mel O'Hagan
af997be2e9 Check type is string before match 2022-05-13 21:25:41 +01:00
Mel O'Hagan
672bfda7dd Fix test for update 2022-05-13 15:57:37 +01:00
Mel O'Hagan
a58f35a6cd Null pointer fix 2022-05-13 15:57:15 +01:00
Mel O'Hagan
094a548e38 MongoDb Delete fix 2022-05-13 15:56:57 +01:00
Mel O'Hagan
4b7f1391f8 Fixed update 2022-05-13 15:56:49 +01:00
Mel O'Hagan
2a98872296 Create ObjectIds from matching string 2022-05-13 15:56:32 +01:00
Michael Drury
cb95b419a7
Merge pull request #5707 from Budibase/fix/mike-fixes-04-05
SQL columns with spaces LIKE fix and dynamic REST variable UI change
2022-05-11 10:34:36 +01:00
Martin McKeaveney
8c5efd0a61 more strategic connection closing in pg 2022-05-10 11:13:40 +01:00
Martin McKeaveney
6cddc3f8f9 merge 2022-05-05 12:45:09 +01:00
mike12345567
13ec670295 Fix for #5669 comment, when using SQL tables with spaces in names, we use a raw knex function for like to achieve lower case searching, this needs to handle spaces in columns and delimiting. 2022-05-04 16:13:54 +01:00
mike12345567
107c9e2dfc Fix for #5553 - when importing for SQL databases attempt to manage date and time only column times, handle these when displaying in tables and when filtering. 2022-05-03 14:11:06 +01:00
mike12345567
be4b930c8a Fix for #5612 - stop some formats of string being in-correctly parsed as dates by MySQL - disable type coercion for data source plus mysql tables (knex converts). 2022-04-29 16:47:43 +01:00
mike12345567
a7fe15244b Fixing issue #5594 - allowing use of double underscores in table names for SQL. 2022-04-29 16:22:11 +01:00
Martin McKeaveney
bfb6e20bb8 adding close to buildSchema 2022-04-29 10:47:42 +01:00
Martin McKeaveney
06774c1452 merge 2022-04-29 00:05:43 +01:00
Martin McKeaveney
4bab24f1ac remove postgres connection pooling 2022-04-28 23:24:52 +01:00
Martin McKeaveney
62f2cff42e firebase tests complete 2022-04-28 22:59:25 +01:00
mike12345567
8d5931f94c Fixing some issues with types being lost when fetching SQL tables, after making changes to tables within Budibase. 2022-04-27 17:11:57 +01:00
mike12345567
056d9defe4 Fix for #5219 - default all string types to basic text format, allow user to switch string types to longform if they desire. 2022-04-27 16:29:03 +01:00
Martin McKeaveney
a5bdf70cf7 renamable buckets, started firebase tests, onboarding modal copy update 2022-04-26 17:12:47 +01:00
Martin McKeaveney
e01ef9bdfb merge with master 2022-04-26 10:21:45 +01:00
Martin McKeaveney
b05d1d9708 merge 2022-04-25 10:24:49 +01:00
Martin McKeaveney
8f26196191 Merge branch 'gsheets-updates' of github.com:Budibase/budibase into gsheets-updates 2022-04-25 09:38:06 +01:00
Martin McKeaveney
9f0cb41f49
Merge branch 'master' into gsheets-updates 2022-04-25 09:27:38 +01:00
Martin McKeaveney
877dfb0e5d moving node fetch import into module 2022-04-25 00:05:32 +01:00
Martin McKeaveney
33717ceb30 auto fetch access token in gsheets integration 2022-04-24 23:32:47 +01:00
Michael Drury
ae385ffd16
Merge pull request #5542 from Budibase/fix/5495
Fix for SQL relationship based formulas
2022-04-22 16:51:24 +01:00
Michael Drury
a3321246e0
Merge pull request #5510 from Budibase/fix/pouch-leak
PouchDB memory leak protection
2022-04-22 15:32:51 +01:00
mike12345567
7e6eaf65d8 Fix for #5530 - make MySQL RejectUnauthorized SSL parameter accessible to the user. 2022-04-22 14:53:36 +01:00
Martin McKeaveney
690ba4f81f use ioredis mock for in memory redis tests 2022-04-21 20:24:43 +01:00
mike12345567
fe846f86a5 Fixing issues with test cases - a lot of test cases didn't setup tenancy in any format, which now means that the API endpoints they call would not have access to a Global DB instance. Also had to disable the closing of the database in test as this was removing the database from memory, meaning future calls would find an empty database when they opened it. 2022-04-21 14:56:14 +01:00
mike12345567
ea6f580501 Initial version of memory leak protection, making sure that PouchDB databases are closed correctly after use, using a combination of closures wrapping DB gets (this replaces the getDB, leaving only a dangerousGetDB function which can be used in very very specific scenarios) and then closing the DB as part of CLS hooked functions finishing. Also moving the GlobalDB init to the tenancy middleware as this is used everywhere in the worker/app services - means that not all getGlobalDB calls require an async closure around them. 2022-04-19 19:42:52 +01:00
mike12345567
5396a8d8e0 Fix for #5411 - trimming the various binding components for SQL in queries. Also moving SQL interpolation out into a Typescript - prep for further unit testing/improvements. 2022-04-14 13:06:22 +01:00
mike12345567
00bcdd317f Fixing issue #5322 - when endpoint is specified for DynamoDB and not in a the region that the whole instance expects it will throw an odd credentials error - making sure connection is commenced everywhere other than localhost. 2022-04-12 18:49:46 +01:00
mike12345567
c4a42cc181 Fix for issue discovered in #5187 - expanding regex to cover all sorts of number coercion. 2022-04-07 10:26:39 +01:00
Martin McKeaveney
cf1e378b6e
Merge branch 'develop' into labday/integrations 2022-04-05 11:59:39 +01:00
mike12345567
62f4ecf3e1 Fixing issue #5817 - making sure that date strings are correctly parsed into the bindings. 2022-04-01 17:13:28 +01:00
Martin McKeaveney
6d8254d5f0 redis integration complete 2022-03-31 15:44:06 +01:00
Martin McKeaveney
81c662f0ca redis integration 2022-03-31 10:56:16 +01:00
Martin McKeaveney
6432ca102a
Update index.ts 2022-03-31 09:40:41 +01:00
Martin McKeaveney
e263cc31bb merge with master 2022-03-30 15:44:22 +01:00
mike12345567
5dcbef58a8 Fix for #5153 - doing it at the mysql level as it seems to be affected by incorrect types in a way that other SQL databases aren't - limits the possible damage this can do. 2022-03-30 14:45:13 +01:00
Martin McKeaveney
04b17fb634 re-add gsheets to self host 2022-03-28 16:46:05 +01:00
Martin McKeaveney
ee6a16827a fixing google sheets bug, respect google configuration hierarchy 2022-03-28 16:44:33 +01:00
Rory Powell
0ee41ea10c Merge branch 'master' into merge-master 2022-03-25 13:10:37 +00:00
Martin McKeaveney
33506bebb4 ignore AWS config when using endpoint field 2022-03-25 10:35:59 +00:00
Andrew Kingston
8e361afcda Allow deep-getting of pagination params from REST responses 2022-03-24 10:07:23 +00:00
mike12345567
d52f6dea05 Adding the ability to expand the max number of rows retrieved by SQL queries (say for table exports). 2022-03-21 17:44:43 +00:00
Martin McKeaveney
fd0a916564
Merge pull request #4871 from Budibase/fix/date-filtering
Date filtering logic
2022-03-21 08:19:03 +00:00
Maurits Lourens
0f5d4733d6 Merge branch 'develop' into google_firebase_integration 2022-03-16 13:40:04 +01:00
Andrew Kingston
72f6bc8930 Add test cases for SQL range filtering changes 2022-03-15 11:52:54 +00:00
Andrew Kingston
bf29fa43b4 Merge branch 'develop' of github.com:Budibase/budibase into fix/date-filtering 2022-03-15 11:44:04 +00:00
Michael Drury
0d7db82c71 Fixing MS-SQL variable sub. 2022-03-12 11:13:41 +00:00
Michael Drury
7f36cc97c9 Switching to correct concat function for oracle. 2022-03-11 00:40:01 +00:00
Michael Drury
05836272dd Adding a mechanism to concat strings in queries, there was a problem when char const strings were wrapping bindings, this should find instances of that and replace with a datasource specific method of concating the constant with the variable. 2022-03-11 00:19:26 +00:00
Andrew Kingston
7a1b362515 Update date filtering to only use a between statement when 2 dates are provided 2022-03-10 10:18:03 +00:00
Maurits Lourens
70c5574e75 finish up Firebase implementation 2022-03-10 00:23:36 +01:00
Maurits Lourens
bdb5b127dd fix connection to firebase using service account 2022-03-09 17:46:25 +01:00
Maurits Lourens
e9405a1802 initial setup for google firebase integration 2022-03-08 17:31:36 +01:00
mike12345567
1357c53ff8 Fixing issue #4811 - when renaming SQL columns use an actual rename alteration rather than dropping the column. 2022-03-07 16:31:35 +00:00
mike12345567
0f1b7b18d5 Making sure that tables are created within the correct schema for MS-SQL. 2022-03-04 15:50:19 +00:00
mike12345567
a7e3389790 Adding the ability to support schemas in MS-SQL. 2022-03-04 15:12:07 +00:00
mike12345567
2123fca557 Fixing various other ms-sql types. 2022-03-04 13:48:21 +00:00
mike12345567
b054c2a198 Merge branch 'develop' of github.com:Budibase/budibase into fix/sql-issues 2022-03-04 12:47:02 +00:00
mike12345567
5d7f4b6ab7 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-03-04 11:25:32 +00:00
Michael Drury
7179cf978a Updating test case to handle new promise library. 2022-03-03 23:50:46 +00:00
mike12345567
07551c54c1 Attempting to fix mysql issue by changing our usage of mysql2 to use the promise version, making sure disconnection always occurs correctly and using a slightly different syntax/approach. 2022-03-03 19:20:26 +00:00
mike12345567
3f150c4a1f Correctly parsing the bit type in ms-sql to boolean. 2022-03-03 17:20:21 +00:00
Michael Drury
94041ced55 Changing how SQL vars are generated so that when new SQL implementations are added they must implement a generation mechanism. 2022-03-02 22:45:10 +00:00
mike12345567
8ce1b471fd Fixes for SQL issues raised by Marty. 2022-03-02 17:40:50 +00:00
mike12345567
407aa2d49b Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 17:28:57 +00:00
mike12345567
03822c7223 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 14:04:23 +00:00
Martin McKeaveney
20b4f5aadc merge with master 2022-02-10 18:57:26 +01:00
Martin McKeaveney
9144fdef6e merge with develop 2022-02-10 11:39:15 +01:00
Martin McKeaveney
e1bc104715 only show gsheets in self host 2022-02-10 11:34:50 +01:00
mike12345567
b9de2c1897 Fix for #3928 - error invalid use of FETCH was based on a lack of sorting on MS-SQL platforms, this enforces a sort of some type no matter what. 2022-02-04 16:17:36 +00:00
mike12345567
b5993f4aa9 Fixing TS issue caused by linting. 2022-02-02 18:18:53 +00:00
mike12345567
fa94ea7b3a Updating the SQL core to allow it to handle multiple relationships between the same two tables. 2022-02-02 18:15:17 +00:00
Martin McKeaveney
394eb44b5f merge 2022-02-01 11:22:14 +01:00
mike12345567
c9d2de8344 Merge branch 'develop' of github.com:Budibase/budibase into lab-day/refactor-app-db 2022-01-31 15:33:36 +00:00
mike12345567
712382af07 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-01-31 14:29:02 +00:00
mike12345567
40c6eb2007 Main body of work, refactoring most usages. 2022-01-27 18:18:31 +00:00