Commit Graph
4040 Commits
Author SHA1 Message Date
Corteza Monorepo Migrator c9c0758fb8 Add files from server-discovery with aux/server-discovery prefix 2022-11-14 09:26:41 +01:00
Corteza Monorepo Migrator 6fcc565cc5 Add README, DCO, CONTRIBUTING and .github files 2022-11-14 09:26:41 +01:00
Corteza Monorepo Migrator 683c7c56e2 Moving server files to ./server 2022-11-14 09:26:39 +01:00
Denis Arh 204738f7c9 Allow use of custom machine ID for sonyflake ID
Use SONYFLAKE_MACHINE_ID with uint16 to specifiy custom
machine ID to be used by Sonyflake. This is usefuly
when your infrastructure network configuration does not follow
IANA rules for private IPs.

Ref: #15
2022-11-14 08:54:04 +01:00
Denis Arh 88bafc2f15 Fix report request crash when using dup. attr idents
When request to /report endpoint with multiple attributes using the same
ident was used, request crashed with an error that Scan expects N+M
destinations but got N.

This was due to the way scan destination slice was constructed, using
column ident as unique key. Only problem for aggregations.

Example:
/report?metrics=SUM(Amount)+AS+sum_amount,SUM(Amount)+AS+sum_amount

Error:
sql: expected 4 destination arguments in Scan, not 3"

This is now done only for attributs with store type SimpleJsonDocColumn.

Ref: #465
2022-11-14 07:52:09 +01:00
Denis Arh 97fd780edf Refactor rdbms-dal code and unify store-ident logic 2022-11-14 07:51:35 +01:00
Denis Arh 5187b63771 Harden record value processing
This commit adds extra checks and for null/object/array types. NULL
values are gracefuly ignored whn found on root or under an attribute.
2022-11-13 12:05:17 +01:00
Vivek Patel b469df74ac Fix generatePageNavigation for total count of records 2022-11-11 22:04:05 +05:30
Denis Arh 13ddb6025e Remove required flag from workflow handle rest endpoints 2022-11-09 16:58:09 +01:00
Denis Arh adf7b17465 Prevent server crash when accessing field w/o initialized options 2022-11-09 16:20:57 +01:00
Peter Grlica e551b735be Fixed apigw route search
Apigw route filtering works with partial endpoint values now instead of
literal search
2022-11-09 14:20:04 +01:00
Tomaž Jerman 79658c0194 Add query support for report list 2022-11-09 12:33:08 +01:00
Denis Arh 084ac727bd Update corteza-locale dep 2022.9.2 2022-11-08 14:07:39 +01:00
Vivek Patel 74876a709b Fix cursor tests 2022-11-08 17:17:36 +05:30
Denis Arh 6297304033 Remove old 'Deep JSON' leftover code 2022-11-08 12:43:27 +01:00
Yangruipis 7f64966b91 fix: use copy instead of reference 2022-11-08 09:37:05 +01:00
Yangruipis 344be08625 fix: export record error && dal.models is not initialized 2022-11-08 09:37:05 +01:00
Denis Arh f6e3035b42 Merge branch '2022.9.x-fix-dal-multi-value-field' into 2022.9.x 2022-11-07 19:02:13 +01:00
Denis Arh 0cb49051d2 Disabled broken integration tests under tests/dal 2022-11-07 19:01:48 +01:00
Denis Arh e70aecb2b8 Add support for "<ref/val> IN <ref>" query for RDBMS
Implementation for SQLite, Postgres and MySQL.
2022-11-07 18:54:41 +01:00
Denis Arh 3bf030685b Extend RDBMS DAL tests and fix issues with bool & numeric types 2022-11-07 18:54:40 +01:00
Denis Arh 65fa23425e Add driver.Nuances to handle subtle differeces between RDBMS drivers in common code 2022-11-07 18:53:56 +01:00
Denis Arh cdacfe0648 Refactor RDBMS drivers, add json-array-contains
A few changes to dialect interface, functions now return exp.Expression
instead of more specific interfaces.

Implement JSON array-contains functionality. This allows us to
re-implement old behaviour where "'value' = multiValField" query
inspected all values inside multi value field.
2022-11-07 18:53:53 +01:00
Denis Arh bfb06b0339 Refactor RDBMS driver tests
RDBMS tests now run on single DB only (one provided in the DB_DSN).
2022-11-07 18:24:14 +01:00
Vivek Patel c759280fb9 Fix dal paging and nav
Along with there were couple other broken impl was fixed accordingly
- Migration of old store test for pagination and sorting
- Fixes store drivers' accordingly for dateTime, number, boolean types and other types
- Refactor drain iterator a bit for pag nav and sorting
- Separation of the paging calculation and record set impl
2022-11-07 22:50:56 +05:30
Tomaž Jerman 6d58bf4e3b Fix improper resource translation management for automation buttons 2022-11-07 15:00:49 +01:00
Tomaž Jerman f5297d33c7 Prevent cases without connection params from crashing the server 2022-11-04 08:20:07 +01:00
Denis Arh cd0b462ca6 Allow configurabe workload when migrating record store
By setting UPGRADE_MIGRATE_OLD_COMPOSE_RECORD_VALUES_BATCH_SIZE
users can configure number of records read from the DB
2022-11-02 17:12:29 +01:00
Vivek Patel 90b54146dc Fix deleted queue issue on update
On update queue deletedAt was being ignored so fixed it by reserving it on update
2022-11-01 15:00:28 +05:30
Jože Fortun 865ee431c1 Update corteza-locale dep 2022.9.2-rc.2 2022-10-28 15:33:30 +02:00
hantian_pang f7c4ccd3b7 Fix fetch all records when no dedup rules
Current dedup config of module is always enable (as front-end comment).
So the better way to control dedup is rules length.
2022-10-28 16:24:44 +05:30
Vivek Patel 18a687a7bd Remove permissions check from privacy connections endpoint 2022-10-27 17:52:33 +05:30
Vivek Patel 50b483b950 Fix resource total count with page cursor
Add check to prevent computing the total resource count with page cursor for resource list apis
2022-10-27 17:20:17 +05:30
Katrin Yordanova a5e192fc99 Allow DPO to edit requests 2022-10-27 13:29:38 +03:00
Jože Fortun 831a57ae90 Update corteza-locale dep 2022.9.2-rc.1 2022-10-26 15:24:09 +02:00
Denis Arh eb7689e169 Fix record value migration on percona 2022-10-26 14:26:25 +02:00
Tomaž Jerman 55702ec256 Temporary patch for invalid type encoding in Compose charts 2022-10-26 11:53:19 +02:00
Shmuel Kamensky eb899925c8 Fix issue #427 (respected required fields)
since ModuleField's attribute "Required" was not explicitly passed as a
negated value to Attribute.Type.Nullable, Attribute.Type.Nullable's
default value always persisted (false). This made all columns required.

This change makes it so the ModuleField's attribute "Required" properly
maps to Attribute.Type.Nullable
2022-10-25 15:21:20 +02:00
Yangruipis 8926c040cd fix: report paging 2022-10-25 15:21:04 +02:00
Katrin Yordanova 79ac014eb7 Reword password not secure error message in auth_actions.yaml 2022-10-25 14:45:40 +02:00
Tomaž Jerman f6266fb3d5 Fix aggregation count when no arguments are provided
Older versions allowed count(), the new one did not.
The new version now allso supports count() which behaves
how it did before.
2022-10-25 14:45:40 +02:00
Tomaž Jerman 24b5d7c72d Improve total and page list computation to be less intensive
The prev. version iterated everything even if we didn't want the
totals there.
The new version ends processing sooner.
2022-10-25 11:09:13 +02:00
Tomaž Jerman bc8a0f0859 Change compose record report dal types to be consistent 2022-10-24 16:07:12 +02:00
hantian_pang a80e2655fe Fix marshal expr.Type into empty object bug
When using to_json(...) marshal expr.Type into string will get empty
object {} if this Type doesn't implement marshal method. So UntypedValue
obj before json.Marshal if this obj isn't json.Marshaler.
2022-10-24 08:10:18 +02:00
Denis Arh 5b2ba54280 Fix sub-workflow filtering 2022-10-23 09:36:21 +02:00
Vivek Patel 5e087748ab Fix locale.ErrorMetaKey case type
Add method to convert string to kebab-case and apply fix to actions.gen.go.tpl for locale.ErrorMetaKey generation.
2022-10-22 15:47:21 +05:30
Vivek Patel 81d6a484a1 Fix settings password constraints validations
Fixes validation for constraint values, which are integer type instead of string
2022-10-21 20:55:39 +05:30
Peter Grlica 702e6255e8 Fixed issue and issue comment notifications for GH actions 2022-10-20 13:26:08 +02:00
Tomaž Jerman e2ac9c4f3e Allow envoy resources to implement custom error wrappers
Custom error wrappers allow additional context for more complex
cases.
2022-10-19 16:48:42 +02:00
Denis Arh a8d2fef3cc Fix broken compose-record reference check
Pre DAL code ignored module ID when doing record lookup. This fix
ensures proper module ID is used (one from the module field options)
when doing lookup
2022-10-19 15:05:59 +02:00