Tomaž Jerman
|
d034197092
|
Add support for expression evaluation
|
2020-03-24 12:32:06 +01:00 |
|
Tomaž Jerman
|
8e31d43c29
|
Add support for composite keys with join opp.
|
2020-03-24 11:00:46 +01:00 |
|
Tomaž Jerman
|
b17b31319d
|
Allow composition for migration maps
This will reduce their size.
|
2020-03-23 22:11:04 +01:00 |
|
Tomaž Jerman
|
e153da5dab
|
Allow different path for migration meta files
|
2020-03-23 22:00:11 +01:00 |
|
Tomaž Jerman
|
6ccc4c7294
|
Add support for per field value mapping
|
2020-03-23 21:39:10 +01:00 |
|
Tomaž Jerman
|
457d5a1561
|
Improve migration source joining system
|
2020-03-23 18:11:54 +01:00 |
|
Tomaž Jerman
|
db90a03c01
|
More descriptive stream splitting errors
|
2020-03-23 17:56:41 +01:00 |
|
Tomaž Jerman
|
0a7a3bf6b5
|
Rework splitted stream header determination
|
2020-03-23 17:56:11 +01:00 |
|
Tomaž Jerman
|
09aa097791
|
Add missing deps
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
d4fdc7f63b
|
Don't include the original migration node for strem splitting
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
4b995099d2
|
Add support for migration source joins
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
53288a00cd
|
Update dep references
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
eeae3dac24
|
Small data handling tweak
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
7a8c16a090
|
Fix SF's white space encoding
They use some special character, not supported by our
character encoding.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
c49124bf31
|
Improve reference fallbacks
If reference can't be established; remove the value so it
doesn't break record resolution.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
39cb2fa434
|
Cleanup field validation
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
b2abfbf613
|
Improve node splicing
Reuse existing spliced nodes to reduce the node count.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
7e80cac4e9
|
Improve sys fields; fix deleted record detection
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
e2781bf901
|
Cleanup
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
d487ef3abf
|
Fix user migration node buffers
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
45b11a6eb9
|
Add a nice progress bar
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
0f22006643
|
Don't die if User not provided
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
8f41cc6323
|
Improve README.adoc
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
eddc114be3
|
Add some benchmarking
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
ac1fd84413
|
Add support for migration mapping
This adds support for splitting a single source into
multiple modules.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
52e4e6c176
|
Run migration in a transaction
Big performance gains, since indexes are defered to
the end.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
e30edaae4f
|
Don't insert empty record values
Big performance gains on sparse data sets.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
5a10619242
|
Assure node parent order on migration
Link splicing caused order to change; broke internal
loops.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
440cf71798
|
Simplify migration source requirements
Remove the need of stream seeking.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
8b82eaee1d
|
Improve thread syncing
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
37a669125e
|
Make migrateable source an io.ReadSeeker
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
b781151aa9
|
Paralelize the migration system
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
18ad7dea98
|
Remove debug spew
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
f7fcccf0a1
|
Allow only satisfied dependencies to appear as a leaf node
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
1d8182e365
|
Add a bit extra documentation regarding the algorithm
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
c5cb20eb9f
|
POC graph based data migration system
Implement a POC data migration system.
See README for more details.
|
2020-03-22 12:08:20 +01:00 |
|
Denis Arh
|
0f659fdeae
|
Extend record constraints to support cr/up/de-at and values matching
New record contraints now support:
- record.updatedAt
- record.createdAt
- record.deletedAt
- record.values.<field-name>
|
2020-03-20 14:23:38 +01:00 |
|
Tomaž Jerman
|
845dc2c4de
|
Fix page ordering by exposing weight
|
2020-03-18 09:55:49 +01:00 |
|
Denis Arh
|
612312c4ca
|
Refactor building and packing pipeline
|
2020-03-18 07:40:35 +01:00 |
|
Denis Arh
|
0c95128bdc
|
More robust record importing initialization, fallback to file ext when text is detected
|
2020-03-16 12:33:41 +01:00 |
|
Denis Arh
|
47db9e7ab9
|
Add version cli command
|
2020-03-16 08:54:30 +01:00 |
|
Denis Arh
|
700fae5e00
|
Call coredor (via gRPC) with independent context & timeout
Reusing context caused random case of context cancelation
on server side and "illegal buffer" error on corredor
|
2020-03-12 20:17:28 +01:00 |
|
Denis Arh
|
7fbd4eab30
|
Fix .env.example for AUTH_JWT_EXPIRY
|
2020-03-12 18:54:07 +01:00 |
|
Denis Arh
|
ed445d120c
|
Sanitization & validation refactoring (dates, refs)
2020.3.0-rc.3
|
2020-03-11 19:45:33 +01:00 |
|
Denis Arh
|
4ab0b61daa
|
Fix another service loading order issue
|
2020-03-11 11:55:49 +01:00 |
|
Denis Arh
|
f4ce3bbbe5
|
Fix problems with multi-value set/del
|
2020-03-10 11:06:21 +01:00 |
|
Denis Arh
|
a5bea8ba75
|
Fix failing provision, remove old automation script RBAC ops
|
2020-03-09 11:13:45 +01:00 |
|
Denis Arh
|
2f3919884e
|
Skip deleted values on insert, fix 0000-00-00 error
|
2020-03-09 10:12:42 +01:00 |
|
Denis Arh
|
76c15ca84f
|
Add list of roles to internal auth rsp
|
2020-03-05 11:16:09 +01:00 |
|
Denis Arh
|
0c9c67e34c
|
Improve store & bucket path handling
|
2020-03-05 10:10:57 +01:00 |
|