3
0
Commit Graph

11 Commits

Author SHA1 Message Date
Tomaž Jerman
26e4832d5c Improve the Envoy package
- Add support for store decoding
- add support for yaml, csv, jsonl encoding
- refactor, cleanup
2021-02-24 15:57:44 +01:00
Tomaž Jerman
c1d7f700c4 Cleanup Envoy
* Improve conflict resolution algorithm.
* Tweak resource merge algorithms.
* Bump test coverage.
2020-12-17 11:56:34 +01:00
Tomaž Jerman
5f3efdbfe6 Allow resource reference constraints
This lets us import multiple different namespaces with modules, ...
at the same time.

Before, there was a chance that a thing from NS 1 would be linked
to a thing in NS 2.
2020-11-30 18:51:46 +01:00
Tomaž Jerman
10b300328d Implement data shaping
Unstructured datasources (csv, jsonl, ...) are defined as resource
datasets.
These datasets are then "shaped" based on some template.

The result is an envoy resource like any other.
2020-11-27 11:19:16 +01:00
Tomaž Jerman
f5ee8419d0 Define NextInverted on the graph 2020-11-27 11:19:15 +01:00
Tomaž Jerman
09d679fba7 Add base tests & post test tweaks 2020-11-27 11:19:15 +01:00
Tomaž Jerman
02620c4ea7 Tweak encoding routines 2020-11-27 11:19:15 +01:00
Tomaž Jerman
651c93fecb Cleanup, rename, restructure core envoy bits 2020-11-27 11:19:15 +01:00
Tomaž Jerman
41d2e8cb93 Rework graph & builder
Make nodes persist through runs (easier re-running).
2020-11-27 11:19:15 +01:00
Tomaž Jerman
1f6f4719eb Tweak graph builder & graph
Builder:
* Make pre-processing structured.

Graph:
* Walker -> Provider,
* simplify resource exec state,
* support for dry-running (will probably rework this).
2020-11-27 11:19:15 +01:00
Tomaž Jerman
e17d63f05f Rework graph construction & processing 2020-11-27 11:19:15 +01:00