Tomaž Jerman
|
62a8ebe965
|
Map alias to handle on user migration
|
2020-03-24 13:31:35 +01:00 |
|
Tomaž Jerman
|
03f6024c49
|
Assure date time format
|
2020-03-24 13:31:02 +01:00 |
|
Tomaž Jerman
|
d034197092
|
Add support for expression evaluation
|
2020-03-24 12:32:06 +01:00 |
|
Tomaž Jerman
|
8e31d43c29
|
Add support for composite keys with join opp.
|
2020-03-24 11:00:46 +01:00 |
|
Tomaž Jerman
|
b17b31319d
|
Allow composition for migration maps
This will reduce their size.
|
2020-03-23 22:11:04 +01:00 |
|
Tomaž Jerman
|
6ccc4c7294
|
Add support for per field value mapping
|
2020-03-23 21:39:10 +01:00 |
|
Tomaž Jerman
|
457d5a1561
|
Improve migration source joining system
|
2020-03-23 18:11:54 +01:00 |
|
Tomaž Jerman
|
db90a03c01
|
More descriptive stream splitting errors
|
2020-03-23 17:56:41 +01:00 |
|
Tomaž Jerman
|
0a7a3bf6b5
|
Rework splitted stream header determination
|
2020-03-23 17:56:11 +01:00 |
|
Tomaž Jerman
|
d4fdc7f63b
|
Don't include the original migration node for strem splitting
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
4b995099d2
|
Add support for migration source joins
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
53288a00cd
|
Update dep references
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
eeae3dac24
|
Small data handling tweak
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
7a8c16a090
|
Fix SF's white space encoding
They use some special character, not supported by our
character encoding.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
c49124bf31
|
Improve reference fallbacks
If reference can't be established; remove the value so it
doesn't break record resolution.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
39cb2fa434
|
Cleanup field validation
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
b2abfbf613
|
Improve node splicing
Reuse existing spliced nodes to reduce the node count.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
7e80cac4e9
|
Improve sys fields; fix deleted record detection
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
e2781bf901
|
Cleanup
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
d487ef3abf
|
Fix user migration node buffers
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
45b11a6eb9
|
Add a nice progress bar
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
0f22006643
|
Don't die if User not provided
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
8f41cc6323
|
Improve README.adoc
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
eddc114be3
|
Add some benchmarking
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
ac1fd84413
|
Add support for migration mapping
This adds support for splitting a single source into
multiple modules.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
52e4e6c176
|
Run migration in a transaction
Big performance gains, since indexes are defered to
the end.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
e30edaae4f
|
Don't insert empty record values
Big performance gains on sparse data sets.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
5a10619242
|
Assure node parent order on migration
Link splicing caused order to change; broke internal
loops.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
440cf71798
|
Simplify migration source requirements
Remove the need of stream seeking.
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
8b82eaee1d
|
Improve thread syncing
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
37a669125e
|
Make migrateable source an io.ReadSeeker
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
b781151aa9
|
Paralelize the migration system
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
18ad7dea98
|
Remove debug spew
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
f7fcccf0a1
|
Allow only satisfied dependencies to appear as a leaf node
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
1d8182e365
|
Add a bit extra documentation regarding the algorithm
|
2020-03-22 12:08:20 +01:00 |
|
Tomaž Jerman
|
c5cb20eb9f
|
POC graph based data migration system
Implement a POC data migration system.
See README for more details.
|
2020-03-22 12:08:20 +01:00 |
|
Denis Arh
|
47db9e7ab9
|
Add version cli command
|
2020-03-16 08:54:30 +01:00 |
|
Denis Arh
|
700fae5e00
|
Call coredor (via gRPC) with independent context & timeout
Reusing context caused random case of context cancelation
on server side and "illegal buffer" error on corredor
|
2020-03-12 20:17:28 +01:00 |
|
Denis Arh
|
2aee9f80b9
|
Add capability to set CORREDOR_MAX_RECEIVE_MESSAGE_SIZE, set default to 16MB
|
2020-03-04 14:19:41 +01:00 |
|
Denis Arh
|
7f0fcc72b9
|
Add @todo for IN operator support in pkg/ql
|
2020-03-04 12:28:58 +01:00 |
|
Denis Arh
|
9405fb84c3
|
Improve handle checking & generation
|
2020-02-28 16:59:32 +01:00 |
|
Denis Arh
|
efb82f721d
|
Remove obsolete automation files & references to it
|
2020-02-26 08:32:17 +01:00 |
|
Denis Arh
|
a78235252f
|
Use clean eventbus for integration tests
|
2020-02-25 08:12:40 +01:00 |
|
Denis Arh
|
19e50302df
|
Comply with corredor settings (enabled/disabled)
|
2020-02-07 13:00:31 +01:00 |
|
Denis Arh
|
4e1a201327
|
Allow indirect (no current user) script execution
|
2020-01-31 00:29:15 +01:00 |
|
Denis Arh
|
37079d77e1
|
Implement if-modified-since logic for client/server script loading
|
2020-01-30 17:17:42 +01:00 |
|
Denis Arh
|
5a16452f51
|
Fix PluckString test
|
2020-01-30 17:03:45 +01:00 |
|
Denis Arh
|
666145a837
|
Protobuf codegen, add uiProps
|
2020-01-29 20:25:49 +01:00 |
|
Denis Arh
|
eeb1a9a831
|
Refactord manual event type filtering logic & strategy
|
2020-01-29 08:16:40 +01:00 |
|
Denis Arh
|
4cf645d11a
|
Add HasString and PluckString to slice pkg
|
2020-01-29 08:15:17 +01:00 |
|