Commit Graph
1735 Commits
Author SHA1 Message Date
Tomaž Jerman 7e80cac4e9 Improve sys fields; fix deleted record detection 2020-03-22 12:08:20 +01:00
Tomaž Jerman e2781bf901 Cleanup 2020-03-22 12:08:20 +01:00
Tomaž Jerman d487ef3abf Fix user migration node buffers 2020-03-22 12:08:20 +01:00
Tomaž Jerman 45b11a6eb9 Add a nice progress bar 2020-03-22 12:08:20 +01:00
Tomaž Jerman 0f22006643 Don't die if User not provided 2020-03-22 12:08:20 +01:00
Tomaž Jerman 8f41cc6323 Improve README.adoc 2020-03-22 12:08:20 +01:00
Tomaž Jerman eddc114be3 Add some benchmarking 2020-03-22 12:08:20 +01:00
Tomaž Jerman ac1fd84413 Add support for migration mapping
This adds support for splitting a single source into
multiple modules.
2020-03-22 12:08:20 +01:00
Tomaž Jerman 52e4e6c176 Run migration in a transaction
Big performance gains, since indexes are defered to
the end.
2020-03-22 12:08:20 +01:00
Tomaž Jerman e30edaae4f Don't insert empty record values
Big performance gains on sparse data sets.
2020-03-22 12:08:20 +01:00
Tomaž Jerman 5a10619242 Assure node parent order on migration
Link splicing caused order to change; broke internal
loops.
2020-03-22 12:08:20 +01:00
Tomaž Jerman 440cf71798 Simplify migration source requirements
Remove the need of stream seeking.
2020-03-22 12:08:20 +01:00
Tomaž Jerman 8b82eaee1d Improve thread syncing 2020-03-22 12:08:20 +01:00
Tomaž Jerman 37a669125e Make migrateable source an io.ReadSeeker 2020-03-22 12:08:20 +01:00
Tomaž Jerman b781151aa9 Paralelize the migration system 2020-03-22 12:08:20 +01:00
Tomaž Jerman 18ad7dea98 Remove debug spew 2020-03-22 12:08:20 +01:00
Tomaž Jerman f7fcccf0a1 Allow only satisfied dependencies to appear as a leaf node 2020-03-22 12:08:20 +01:00
Tomaž Jerman 1d8182e365 Add a bit extra documentation regarding the algorithm 2020-03-22 12:08:20 +01:00
Tomaž Jerman c5cb20eb9f POC graph based data migration system
Implement a POC data migration system.
See README for more details.
2020-03-22 12:08:20 +01:00
Denis Arh 0f659fdeae Extend record constraints to support cr/up/de-at and values matching
New record contraints now support:
 - record.updatedAt
 - record.createdAt
 - record.deletedAt
 - record.values.<field-name>
2020-03-20 14:23:38 +01:00
Tomaž Jerman 845dc2c4de Fix page ordering by exposing weight 2020-03-18 09:55:49 +01:00
Denis Arh 612312c4ca Refactor building and packing pipeline 2020-03-18 07:40:35 +01:00
Denis Arh 0c95128bdc More robust record importing initialization, fallback to file ext when text is detected 2020-03-16 12:33:41 +01:00
Denis Arh 47db9e7ab9 Add version cli command 2020-03-16 08:54:30 +01:00
Denis Arh 700fae5e00 Call coredor (via gRPC) with independent context & timeout
Reusing context caused random case of context cancelation
on server side and "illegal buffer" error on corredor
2020-03-12 20:17:28 +01:00
Denis Arh 7fbd4eab30 Fix .env.example for AUTH_JWT_EXPIRY 2020-03-12 18:54:07 +01:00
Denis Arh ed445d120c Sanitization & validation refactoring (dates, refs) 2020.3.0-rc.3 2020-03-11 19:45:33 +01:00
Denis Arh 4ab0b61daa Fix another service loading order issue 2020-03-11 11:55:49 +01:00
Denis Arh f4ce3bbbe5 Fix problems with multi-value set/del 2020-03-10 11:06:21 +01:00
Denis Arh a5bea8ba75 Fix failing provision, remove old automation script RBAC ops 2020-03-09 11:13:45 +01:00
Denis Arh 2f3919884e Skip deleted values on insert, fix 0000-00-00 error 2020-03-09 10:12:42 +01:00
Denis Arh 76c15ca84f Add list of roles to internal auth rsp 2020-03-05 11:16:09 +01:00
Denis Arh 0c9c67e34c Improve store & bucket path handling 2020-03-05 10:10:57 +01:00
Denis Arh 86fcfff237 Cleanup auth response, add list of roles 2020-03-04 21:40:53 +01:00
Denis Arh 2aee9f80b9 Add capability to set CORREDOR_MAX_RECEIVE_MESSAGE_SIZE, set default to 16MB 2020-03-04 14:19:41 +01:00
Denis Arh 7f0fcc72b9 Add @todo for IN operator support in pkg/ql 2020-03-04 12:28:58 +01:00
Denis Arh bed6317d71 Swap service startup order 2020-03-03 18:32:54 +01:00
Denis Arh 54db6d83c8 Add unmask.* operations to provision for admin 2020-02-28 21:01:24 +01:00
Denis Arh fcf1ab44e4 Another cleanup of old version automation relics 2020-02-28 17:32:00 +01:00
Denis Arh 83d78aec8f Fix user tests 2020-02-28 17:31:42 +01:00
Denis Arh 743eb8d509 Bug: use proper condition when unmasking email 2020-02-28 17:31:23 +01:00
Denis Arh 9405fb84c3 Improve handle checking & generation 2020-02-28 16:59:32 +01:00
Denis Arh bb2597b712 Load current settings before cli user ops 2020-02-27 13:46:42 +01:00
Denis Arh ca78df21f0 User email & name privacy 2020-02-26 20:25:31 +01:00
Denis Arh 83a7707ac0 Remove permissions related to legacy automation 2020-02-26 20:24:44 +01:00
Denis Arh cc4c3d115e Fix user list output 2020-02-26 14:01:33 +01:00
Denis Arh efb82f721d Remove obsolete automation files & references to it 2020-02-26 08:32:17 +01:00
Denis Arh 303b0cc0d5 Deps cleanup 2020-02-26 08:21:16 +01:00
Denis Arh d2fcb352ec Cleanup & refactor protobuf codegen 2020-02-26 08:20:59 +01:00
Denis Arh c34814b855 Fix buggy default value setter 2020-02-25 20:00:47 +01:00