Commit Graph
95 Commits
Author SHA1 Message Date
Denis Arh 2405ebb187 Add support for partial config (provisioning) import 2021-03-12 08:14:53 +01:00
Tomaž Jerman 1d5bedc2be Add template provisioning 2021-03-09 15:49:04 +01:00
Denis Arh 67d0a788df Remove messaging 2021-03-09 07:36:01 +01:00
Tomaž Jerman 404244c732 Fix Envoy setting value handling 2021-03-04 10:44:56 +01:00
Tomaž Jerman 1e44e4299b Rework system/application sorting via weight 2021-03-03 12:33:28 +01:00
Tomaž Jerman 26e4832d5c Improve the Envoy package
- Add support for store decoding
- add support for yaml, csv, jsonl encoding
- refactor, cleanup
2021-02-24 15:57:44 +01:00
Tomaž Jerman 828bc69fc7 Fix merge lapsus 2021-02-04 15:40:47 +01:00
Denis Arh c1fe2a80b5 Refactor yaml utils into sep. package (y7s) 2021-01-25 18:05:24 +01:00
Tomaž Jerman e32db506f2 Fix record import via some CSV files
Some CSV files failed to detect as text/csv so the import failed.
ref: https://github.com/gabriel-vasile/mimetype/issues/138
2021-01-25 18:05:24 +01:00
Tomaž Jerman ce21db2197 Fix record import via some CSV files
Some CSV files failed to detect as text/csv so the import failed.
ref: https://github.com/gabriel-vasile/mimetype/issues/138
2021-01-15 12:12:01 +01:00
Tomaž Jerman ce34993b74 Round timestamps to a second accuracy
Different parts of the system (FE, API, store) may use different
standards so operations like IsStale check may fail.
2020-12-21 09:15:08 +01:00
Tomaž Jerman 4e7f150e81 Fix graph cycle resolution 2020-12-18 11:16:13 +01:00
Tomaž Jerman c1d7f700c4 Cleanup Envoy
* Improve conflict resolution algorithm.
* Tweak resource merge algorithms.
* Bump test coverage.
2020-12-17 11:56:34 +01:00
Tomaž Jerman dad6be64cb Add support for legacy resource identifiers in envoy
Allow module name, chart name, page title, ... to act as identifiers.
If a value is not unique, the system fails with an error.
2020-12-14 16:24:24 +01:00
Tomaž Jerman 3306a2435d Fix envoy record pointer lapsus 2020-12-11 12:19:55 +01:00
Tomaž Jerman cb5793d468 Expand envoy configuration options
Better `skipIf` & `onExisting` support.
2020-12-10 18:54:31 +01:00
Tomaž Jerman a2110b26db Improve envoy system values
Handle timestamps & user stamps.
2020-12-02 15:08:52 +01:00
Tomaž Jerman 3444ac3021 Rename conditional envoy processing property 2020-12-02 09:58:50 +01:00
Tomaž Jerman 561fb2f052 Fix envoy settings from multiple sources 2020-12-02 09:25:08 +01:00
Tomaž Jerman 22785ad10b Add conditional envoy processing for compose records 2020-12-01 14:23:12 +01:00
Tomaž Jerman 3a9891431d Fix compose module field unmarshling; fix directory decoding 2020-12-01 10:27:58 +01:00
Denis Arh 4b0031fd81 Add support in YAML decoders for module field expr 2020-11-30 21:42:08 +01:00
Denis Arh 0cd101cdd6 Comment typos fixed 2020-11-30 20:27:10 +01:00
Denis Arh b0f0e8fa60 Add channel name as envoy resource identifier
This will prevent creation of chan dups
2020-11-30 20:24:41 +01:00
Denis Arh 0465a635f5 Fix directory decoding 2020-11-30 19:51:18 +01:00
Denis Arh d89450ae39 Ported messaging provision to envoy 2020-11-30 19:51:18 +01:00
Tomaž Jerman 5f3efdbfe6 Allow resource reference constraints
This lets us import multiple different namespaces with modules, ...
at the same time.

Before, there was a chance that a thing from NS 1 would be linked
to a thing in NS 2.
2020-11-30 18:51:46 +01:00
Tomaž Jerman bcec07f8ff Fix reference field data types
From uint64 -> string.
2020-11-28 14:07:19 +01:00
Tomaž Jerman b82f280a89 Allow compose record shaping to work without keys 2020-11-27 18:59:25 +01:00
Tomaž Jerman eb2d98cbf0 Allow simple interaction with record encoder
Mainly used for record importer; might rework/remove at a later
point.
2020-11-27 18:59:25 +01:00
Tomaž Jerman 851a9a7e11 Tweak content type determination for resource decoders 2020-11-27 18:59:25 +01:00
Tomaž Jerman 9ad4a29d34 Remove flaky jsonl tests 2020-11-27 11:19:16 +01:00
Tomaž Jerman 21b11198ef Extend shaping integration tests for jsonl 2020-11-27 11:19:16 +01:00
Tomaž Jerman a0b7716244 Shaping tests & post tweaks 2020-11-27 11:19:16 +01:00
Tomaž Jerman 10b300328d Implement data shaping
Unstructured datasources (csv, jsonl, ...) are defined as resource
datasets.
These datasets are then "shaped" based on some template.

The result is an envoy resource like any other.
2020-11-27 11:19:16 +01:00
Tomaž Jerman 7ca422bdd3 Remove deprecated decoder things
* loader interface,
* needless FileInfo.
2020-11-27 11:19:15 +01:00
Tomaž Jerman 8b6b322c1b Move envoy tests under integration tests 2020-11-27 11:19:15 +01:00
Tomaž Jerman 72ac5fa2ac Add a provision testcase 2020-11-27 11:19:15 +01:00
Tomaž Jerman 9aa968e36a Rename tests/main go 2020-11-27 11:19:15 +01:00
Tomaž Jerman 72c1885ee8 Small file ext tweak 2020-11-27 11:19:15 +01:00
Tomaž Jerman f5ee8419d0 Define NextInverted on the graph 2020-11-27 11:19:15 +01:00
Tomaž Jerman 93a081d46c Cleanup old tests; post test tweaks 2020-11-27 11:19:15 +01:00
Tomaž Jerman ebfca604f0 Add compose record tests & post test tweaks 2020-11-27 11:19:15 +01:00
Tomaž Jerman 09d679fba7 Add base tests & post test tweaks 2020-11-27 11:19:15 +01:00
Tomaž Jerman 0bcd620a18 Improve errors; post tweaks 2020-11-27 11:19:15 +01:00
Tomaž Jerman 892c7dfe3c Tweak resource finding logic 2020-11-27 11:19:15 +01:00
Tomaž Jerman 02620c4ea7 Tweak encoding routines 2020-11-27 11:19:15 +01:00
Tomaž Jerman 31c672e2e4 Implement base store encoder states 2020-11-27 11:19:15 +01:00
Tomaž Jerman 651c93fecb Cleanup, rename, restructure core envoy bits 2020-11-27 11:19:15 +01:00
Tomaž Jerman a40f936f37 Yaml decoder tweaks based on resources & store 2020-11-27 11:19:15 +01:00