1
0
Fork 0
mirror of synced 2024-07-02 13:01:09 +12:00
Commit graph

872 commits

Author SHA1 Message Date
Mel O'Hagan e23d29b7ef lint 2022-08-08 21:57:36 +01:00
Mel O'Hagan 88f06539a4 Nested braces parse fix added for MongoDB 2022-08-08 21:56:55 +01:00
Mel O'Hagan 98d8080826 Bug fix findOneAndUpdate 2022-08-08 17:53:17 +01:00
Mel O'Hagan d02e5ae87f Add unit tests for ObjectId 2022-08-08 17:01:56 +01:00
Mel O'Hagan c57fc1cfcd Merge branch 'develop' into bug/sev2/mongodb-fixes 2022-08-08 15:15:03 +01:00
mike12345567 df074c6004 Fixing test cases. 2022-08-03 18:20:07 +01:00
mike12345567 5eeb2ea600 Updating the filter system to allow adding multiple filter properties of the same name at once, as well as enabling the use of the allOr property from within the UI - resolves an old issue #2585. 2022-08-02 18:34:58 +01:00
mike12345567 a99ed3bf52 Merge branch 'master' of github.com:Budibase/budibase into fix/6737 2022-08-01 19:00:17 +01:00
mike12345567 5aea08fdce Adding mechanism to allow displaying an error on data retrieval for tables. 2022-08-01 18:56:59 +01:00
mike12345567 41683c1f6d Fix for #6737 - making it so that if a column is deleted externally tables can be re-fetched and this will be fixed. 2022-08-01 17:40:35 +01:00
Mel O'Hagan 432a8eb1b7 Has any support SQL Server 2022-07-28 09:20:00 +01:00
Mel O'Hagan 600794de66 SQL Server containsAny unit test 2022-07-27 16:40:07 +01:00
Mel O'Hagan 9369498d38 Has any of filter Postgres 2022-07-27 16:37:29 +01:00
Mel O'Hagan 804d1ef8f6 Has any of MySQL filter 2022-07-27 13:19:47 +01:00
Mel O'Hagan d9823faac6 Not Contains for SQL Server 2022-07-27 11:56:57 +01:00
Mel O'Hagan 54643cff58 Not Contains Postgres filter 2022-07-27 11:49:45 +01:00
Mel O'Hagan 8d7fe78028 Not Contains filter for MySQL 2022-07-27 11:40:46 +01:00
Mel O'Hagan 4135c4ce59 Fix unit tests 2022-07-26 16:58:01 +01:00
Mel O'Hagan 91f906877f Has all of SQLServer 2022-07-26 16:45:05 +01:00
Mel O'Hagan 3d263f3927 MySQL has all of 2022-07-26 16:16:46 +01:00
Mel O'Hagan f436c50b5b Postgres has all of 2022-07-26 15:59:49 +01:00
Mel O'Hagan 0ead7fca54 lint 2022-07-26 11:38:34 +01:00
Mel O'Hagan 377aca0458 Support ObjectId in operator blocks 2022-07-26 10:53:53 +01:00
Mel O'Hagan f653345296 Added unit tests for contains filter 2022-07-21 10:28:54 +01:00
Mel O'Hagan 6b81d3d727 Handle numeric types Postgres 2022-07-19 18:34:30 +01:00
Mel O'Hagan cd0bac74e2 Prettier 2022-07-19 18:04:27 +01:00
Mel O'Hagan e5dc38845b Added contains support for datasource pluses 2022-07-19 17:25:41 +01:00
mike12345567 2272c095b7 Fix for ARM processors. 2022-07-13 12:37:55 +01:00
Mel O'Hagan 65aab29ee6 Don't try to check externalType of related tables 2022-07-05 16:59:32 +01:00
Dean 4b296f9bce Merge remote-tracking branch 'origin/develop' into feature/current-user-rest-bindings 2022-06-29 18:50:14 +01:00
mike12345567 f0dd336b15 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-24 17:50:55 +01:00
Andrew Kingston 27d5f2ba6e
Merge pull request #6443 from Budibase/datasource-labels
Datasource labels
2022-06-23 15:32:28 +01:00
Mel O'Hagan 688a46f75e Added Knex.Raw to return type 2022-06-23 13:09:22 +01:00
Andrew Kingston 5dd8186383 Add types to datasources 2022-06-23 11:35:57 +01:00
Mel O'Hagan 1d6f780c72 Refactor - simplify regex and use enum 2022-06-23 09:41:43 +01:00
Mel O'Hagan 0fb46ca465 Only cast money as numeric for Postgres 2022-06-22 16:13:02 +01:00
Mel O'Hagan bc72b63579 Use raw sql to get money type as numeric 2022-06-22 15:58:15 +01:00
Mel O'Hagan ba0916d161 Added external types to ds+ schemas 2022-06-20 18:08:30 +01:00
Mel O'Hagan 78a3043aed Include external SQL server type in schema 2022-06-20 16:49:58 +01:00
Dean 3b68abf407 Merge remote-tracking branch 'origin/develop' into feature/current-user-rest-bindings 2022-06-20 09:09:21 +01:00
Mel O'Hagan 5f9944af34 Add empty options if missing for delete 2022-06-17 16:54:23 +01:00
Dean 18f2e13a30 Fixes for Rest API request UI. Rest test fixes for XML API request body. Fix for raw XML api request body parsing issue. General fixes for query testing. 2022-06-17 12:00:42 +01:00
mike12345567 a46d73931d Merge branch 'master' of github.com:Budibase/budibase into develop 2022-06-17 11:41:34 +01:00
Dean 57b8ae7842 Fix to ignore global rest query headers when they are not configured. 2022-06-15 10:09:47 +01:00
Rory Powell 05aca077d1 Merge branch 'release' into merge-release 2022-06-13 11:58:14 +01:00
Rory Powell 05f0393310 Merge branch 'release' into merge-release 2022-06-13 11:45:18 +01:00
Mel O'Hagan 9bb0dba973 Remove duplicate equals 2022-06-10 15:52:28 +01:00
Mel O'Hagan 86d0d37fd5 Fix for privatekey newline 2022-06-10 14:15:25 +01:00
Mel O'Hagan aedda40891 Removed ServiceAccount to reduce confusion 2022-06-10 14:04:34 +01:00
Mel O'Hagan 91b97698a6 Rename Firebase to Firestore 2022-06-08 12:05:29 +01:00
Andrew Kingston 3a9e4fff87 Account for types being undefined when running in a test env 2022-06-07 08:41:45 +01:00
Andrew Kingston f2e3b2efa8 Apply timezones patch from existing ignore-timezones branch 2022-06-07 08:31:00 +01:00
Martin McKeaveney 493607b853 update google sheets strategy to use the standard passport strategy 2022-06-05 16:43:04 +01:00
Mel O'Hagan 87c0df55f0 Using snowflake-promise 2022-06-01 11:41:41 +01:00
Mel O'Hagan b282102998 Revert "Datasource plus - build schema"
This reverts commit 3c1d32ba24.
2022-06-01 09:36:42 +01:00
Mel O'Hagan be8cd07cdc Revert "primaryKey name fix"
This reverts commit fcdc2bf584.
2022-06-01 09:36:28 +01:00
Mel O'Hagan fcdc2bf584 primaryKey name fix 2022-05-31 14:47:27 +01:00
Mel O'Hagan 3c1d32ba24 Datasource plus - build schema 2022-05-31 14:39:53 +01:00
Mel O'Hagan a940269051 CRUD added for snowflake 2022-05-31 13:10:16 +01:00
Mel O'Hagan 31aa9418dd Added types and error handling 2022-05-31 11:58:03 +01:00
Mel O'Hagan a2a29caeea Added Snowflake integration 2022-05-30 21:13:45 +01:00
mike12345567 5f8cfcdb5c Opening connection for building schema. 2022-05-20 17:43:47 +01:00
mike12345567 a23e4efd8c Fix for Postgres connections, seemed to be some issues with out of order, connections not opening in time. 2022-05-20 17:41:27 +01:00
Mel O'Hagan 2c2eb69ae7 Improve parseQueryParams regex 2022-05-17 12:11:43 +01:00
Mel O'Hagan aa0c09ac82 Parse params if needed 2022-05-16 22:44:38 +01:00
Mel O'Hagan c6591490d3 Using mongodb types 2022-05-16 09:50:47 +01:00
Mel O'Hagan 6709eea7cc Removed unused aws Object import 2022-05-16 08:43:27 +01:00
Mel O'Hagan bf144858bb Lowercase the object typo 2022-05-16 08:42:09 +01:00
Mel O'Hagan af997be2e9 Check type is string before match 2022-05-13 21:25:41 +01:00
Mel O'Hagan 672bfda7dd Fix test for update 2022-05-13 15:57:37 +01:00
Mel O'Hagan a58f35a6cd Null pointer fix 2022-05-13 15:57:15 +01:00
Mel O'Hagan 094a548e38 MongoDb Delete fix 2022-05-13 15:56:57 +01:00
Mel O'Hagan 4b7f1391f8 Fixed update 2022-05-13 15:56:49 +01:00
Mel O'Hagan 2a98872296 Create ObjectIds from matching string 2022-05-13 15:56:32 +01:00
Michael Drury cb95b419a7
Merge pull request #5707 from Budibase/fix/mike-fixes-04-05
SQL columns with spaces LIKE fix and dynamic REST variable UI change
2022-05-11 10:34:36 +01:00
Martin McKeaveney 8c5efd0a61 more strategic connection closing in pg 2022-05-10 11:13:40 +01:00
Martin McKeaveney 6cddc3f8f9 merge 2022-05-05 12:45:09 +01:00
mike12345567 13ec670295 Fix for #5669 comment, when using SQL tables with spaces in names, we use a raw knex function for like to achieve lower case searching, this needs to handle spaces in columns and delimiting. 2022-05-04 16:13:54 +01:00
mike12345567 107c9e2dfc Fix for #5553 - when importing for SQL databases attempt to manage date and time only column times, handle these when displaying in tables and when filtering. 2022-05-03 14:11:06 +01:00
mike12345567 be4b930c8a Fix for #5612 - stop some formats of string being in-correctly parsed as dates by MySQL - disable type coercion for data source plus mysql tables (knex converts). 2022-04-29 16:47:43 +01:00
mike12345567 a7fe15244b Fixing issue #5594 - allowing use of double underscores in table names for SQL. 2022-04-29 16:22:11 +01:00
Martin McKeaveney bfb6e20bb8 adding close to buildSchema 2022-04-29 10:47:42 +01:00
Martin McKeaveney 06774c1452 merge 2022-04-29 00:05:43 +01:00
Martin McKeaveney 4bab24f1ac remove postgres connection pooling 2022-04-28 23:24:52 +01:00
Martin McKeaveney 62f2cff42e firebase tests complete 2022-04-28 22:59:25 +01:00
mike12345567 8d5931f94c Fixing some issues with types being lost when fetching SQL tables, after making changes to tables within Budibase. 2022-04-27 17:11:57 +01:00
mike12345567 056d9defe4 Fix for #5219 - default all string types to basic text format, allow user to switch string types to longform if they desire. 2022-04-27 16:29:03 +01:00
Martin McKeaveney a5bdf70cf7 renamable buckets, started firebase tests, onboarding modal copy update 2022-04-26 17:12:47 +01:00
Martin McKeaveney e01ef9bdfb merge with master 2022-04-26 10:21:45 +01:00
Martin McKeaveney b05d1d9708 merge 2022-04-25 10:24:49 +01:00
Martin McKeaveney 8f26196191 Merge branch 'gsheets-updates' of github.com:Budibase/budibase into gsheets-updates 2022-04-25 09:38:06 +01:00
Martin McKeaveney 9f0cb41f49
Merge branch 'master' into gsheets-updates 2022-04-25 09:27:38 +01:00
Martin McKeaveney 877dfb0e5d moving node fetch import into module 2022-04-25 00:05:32 +01:00
Martin McKeaveney 33717ceb30 auto fetch access token in gsheets integration 2022-04-24 23:32:47 +01:00
Michael Drury ae385ffd16
Merge pull request #5542 from Budibase/fix/5495
Fix for SQL relationship based formulas
2022-04-22 16:51:24 +01:00
Michael Drury a3321246e0
Merge pull request #5510 from Budibase/fix/pouch-leak
PouchDB memory leak protection
2022-04-22 15:32:51 +01:00
mike12345567 7e6eaf65d8 Fix for #5530 - make MySQL RejectUnauthorized SSL parameter accessible to the user. 2022-04-22 14:53:36 +01:00
Martin McKeaveney 690ba4f81f use ioredis mock for in memory redis tests 2022-04-21 20:24:43 +01:00
mike12345567 fe846f86a5 Fixing issues with test cases - a lot of test cases didn't setup tenancy in any format, which now means that the API endpoints they call would not have access to a Global DB instance. Also had to disable the closing of the database in test as this was removing the database from memory, meaning future calls would find an empty database when they opened it. 2022-04-21 14:56:14 +01:00
mike12345567 ea6f580501 Initial version of memory leak protection, making sure that PouchDB databases are closed correctly after use, using a combination of closures wrapping DB gets (this replaces the getDB, leaving only a dangerousGetDB function which can be used in very very specific scenarios) and then closing the DB as part of CLS hooked functions finishing. Also moving the GlobalDB init to the tenancy middleware as this is used everywhere in the worker/app services - means that not all getGlobalDB calls require an async closure around them. 2022-04-19 19:42:52 +01:00
mike12345567 5396a8d8e0 Fix for #5411 - trimming the various binding components for SQL in queries. Also moving SQL interpolation out into a Typescript - prep for further unit testing/improvements. 2022-04-14 13:06:22 +01:00
mike12345567 00bcdd317f Fixing issue #5322 - when endpoint is specified for DynamoDB and not in a the region that the whole instance expects it will throw an odd credentials error - making sure connection is commenced everywhere other than localhost. 2022-04-12 18:49:46 +01:00
mike12345567 c4a42cc181 Fix for issue discovered in #5187 - expanding regex to cover all sorts of number coercion. 2022-04-07 10:26:39 +01:00
Martin McKeaveney cf1e378b6e
Merge branch 'develop' into labday/integrations 2022-04-05 11:59:39 +01:00
mike12345567 62f4ecf3e1 Fixing issue #5817 - making sure that date strings are correctly parsed into the bindings. 2022-04-01 17:13:28 +01:00
Martin McKeaveney 6d8254d5f0 redis integration complete 2022-03-31 15:44:06 +01:00
Martin McKeaveney 81c662f0ca redis integration 2022-03-31 10:56:16 +01:00
Martin McKeaveney 6432ca102a
Update index.ts 2022-03-31 09:40:41 +01:00
Martin McKeaveney e263cc31bb merge with master 2022-03-30 15:44:22 +01:00
mike12345567 5dcbef58a8 Fix for #5153 - doing it at the mysql level as it seems to be affected by incorrect types in a way that other SQL databases aren't - limits the possible damage this can do. 2022-03-30 14:45:13 +01:00
Martin McKeaveney 04b17fb634 re-add gsheets to self host 2022-03-28 16:46:05 +01:00
Martin McKeaveney ee6a16827a fixing google sheets bug, respect google configuration hierarchy 2022-03-28 16:44:33 +01:00
Rory Powell 0ee41ea10c Merge branch 'master' into merge-master 2022-03-25 13:10:37 +00:00
Martin McKeaveney 33506bebb4 ignore AWS config when using endpoint field 2022-03-25 10:35:59 +00:00
Andrew Kingston 8e361afcda Allow deep-getting of pagination params from REST responses 2022-03-24 10:07:23 +00:00
mike12345567 d52f6dea05 Adding the ability to expand the max number of rows retrieved by SQL queries (say for table exports). 2022-03-21 17:44:43 +00:00
Martin McKeaveney fd0a916564
Merge pull request #4871 from Budibase/fix/date-filtering
Date filtering logic
2022-03-21 08:19:03 +00:00
Maurits Lourens 0f5d4733d6 Merge branch 'develop' into google_firebase_integration 2022-03-16 13:40:04 +01:00
Andrew Kingston 72f6bc8930 Add test cases for SQL range filtering changes 2022-03-15 11:52:54 +00:00
Andrew Kingston bf29fa43b4 Merge branch 'develop' of github.com:Budibase/budibase into fix/date-filtering 2022-03-15 11:44:04 +00:00
Michael Drury 0d7db82c71 Fixing MS-SQL variable sub. 2022-03-12 11:13:41 +00:00
Michael Drury 7f36cc97c9 Switching to correct concat function for oracle. 2022-03-11 00:40:01 +00:00
Michael Drury 05836272dd Adding a mechanism to concat strings in queries, there was a problem when char const strings were wrapping bindings, this should find instances of that and replace with a datasource specific method of concating the constant with the variable. 2022-03-11 00:19:26 +00:00
Andrew Kingston 7a1b362515 Update date filtering to only use a between statement when 2 dates are provided 2022-03-10 10:18:03 +00:00
Maurits Lourens 70c5574e75 finish up Firebase implementation 2022-03-10 00:23:36 +01:00
Maurits Lourens bdb5b127dd fix connection to firebase using service account 2022-03-09 17:46:25 +01:00
Maurits Lourens e9405a1802 initial setup for google firebase integration 2022-03-08 17:31:36 +01:00
mike12345567 1357c53ff8 Fixing issue #4811 - when renaming SQL columns use an actual rename alteration rather than dropping the column. 2022-03-07 16:31:35 +00:00
mike12345567 0f1b7b18d5 Making sure that tables are created within the correct schema for MS-SQL. 2022-03-04 15:50:19 +00:00
mike12345567 a7e3389790 Adding the ability to support schemas in MS-SQL. 2022-03-04 15:12:07 +00:00
mike12345567 2123fca557 Fixing various other ms-sql types. 2022-03-04 13:48:21 +00:00
mike12345567 b054c2a198 Merge branch 'develop' of github.com:Budibase/budibase into fix/sql-issues 2022-03-04 12:47:02 +00:00
mike12345567 5d7f4b6ab7 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-03-04 11:25:32 +00:00
Michael Drury 7179cf978a Updating test case to handle new promise library. 2022-03-03 23:50:46 +00:00
mike12345567 07551c54c1 Attempting to fix mysql issue by changing our usage of mysql2 to use the promise version, making sure disconnection always occurs correctly and using a slightly different syntax/approach. 2022-03-03 19:20:26 +00:00
mike12345567 3f150c4a1f Correctly parsing the bit type in ms-sql to boolean. 2022-03-03 17:20:21 +00:00
Michael Drury 94041ced55 Changing how SQL vars are generated so that when new SQL implementations are added they must implement a generation mechanism. 2022-03-02 22:45:10 +00:00
mike12345567 8ce1b471fd Fixes for SQL issues raised by Marty. 2022-03-02 17:40:50 +00:00
mike12345567 407aa2d49b Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 17:28:57 +00:00
mike12345567 03822c7223 Fix for #4431 - converting SQL joins back to left joins, syntax specifying join type as string is old which doesn't work in latest versions of knex. 2022-02-11 14:04:23 +00:00
Martin McKeaveney 20b4f5aadc merge with master 2022-02-10 18:57:26 +01:00
Martin McKeaveney 9144fdef6e merge with develop 2022-02-10 11:39:15 +01:00
Martin McKeaveney e1bc104715 only show gsheets in self host 2022-02-10 11:34:50 +01:00
mike12345567 b9de2c1897 Fix for #3928 - error invalid use of FETCH was based on a lack of sorting on MS-SQL platforms, this enforces a sort of some type no matter what. 2022-02-04 16:17:36 +00:00
mike12345567 b5993f4aa9 Fixing TS issue caused by linting. 2022-02-02 18:18:53 +00:00
mike12345567 fa94ea7b3a Updating the SQL core to allow it to handle multiple relationships between the same two tables. 2022-02-02 18:15:17 +00:00
Martin McKeaveney 394eb44b5f merge 2022-02-01 11:22:14 +01:00
mike12345567 c9d2de8344 Merge branch 'develop' of github.com:Budibase/budibase into lab-day/refactor-app-db 2022-01-31 15:33:36 +00:00
mike12345567 712382af07 Merge branch 'master' of github.com:Budibase/budibase into develop 2022-01-31 14:29:02 +00:00
mike12345567 40c6eb2007 Main body of work, refactoring most usages. 2022-01-27 18:18:31 +00:00