3
0
Commit Graph

95 Commits

Author SHA1 Message Date
Denis Arh
2405ebb187 Add support for partial config (provisioning) import 2021-03-12 08:14:53 +01:00
Tomaž Jerman
1d5bedc2be Add template provisioning 2021-03-09 15:49:04 +01:00
Denis Arh
67d0a788df Remove messaging 2021-03-09 07:36:01 +01:00
Tomaž Jerman
404244c732 Fix Envoy setting value handling 2021-03-04 10:44:56 +01:00
Tomaž Jerman
1e44e4299b Rework system/application sorting via weight 2021-03-03 12:33:28 +01:00
Tomaž Jerman
26e4832d5c Improve the Envoy package
- Add support for store decoding
- add support for yaml, csv, jsonl encoding
- refactor, cleanup
2021-02-24 15:57:44 +01:00
Tomaž Jerman
828bc69fc7 Fix merge lapsus 2021-02-04 15:40:47 +01:00
Denis Arh
c1fe2a80b5 Refactor yaml utils into sep. package (y7s) 2021-01-25 18:05:24 +01:00
Tomaž Jerman
e32db506f2 Fix record import via some CSV files
Some CSV files failed to detect as text/csv so the import failed.
ref: https://github.com/gabriel-vasile/mimetype/issues/138
2021-01-25 18:05:24 +01:00
Tomaž Jerman
ce21db2197 Fix record import via some CSV files
Some CSV files failed to detect as text/csv so the import failed.
ref: https://github.com/gabriel-vasile/mimetype/issues/138
2021-01-15 12:12:01 +01:00
Tomaž Jerman
ce34993b74 Round timestamps to a second accuracy
Different parts of the system (FE, API, store) may use different
standards so operations like IsStale check may fail.
2020-12-21 09:15:08 +01:00
Tomaž Jerman
4e7f150e81 Fix graph cycle resolution 2020-12-18 11:16:13 +01:00
Tomaž Jerman
c1d7f700c4 Cleanup Envoy
* Improve conflict resolution algorithm.
* Tweak resource merge algorithms.
* Bump test coverage.
2020-12-17 11:56:34 +01:00
Tomaž Jerman
dad6be64cb Add support for legacy resource identifiers in envoy
Allow module name, chart name, page title, ... to act as identifiers.
If a value is not unique, the system fails with an error.
2020-12-14 16:24:24 +01:00
Tomaž Jerman
3306a2435d Fix envoy record pointer lapsus 2020-12-11 12:19:55 +01:00
Tomaž Jerman
cb5793d468 Expand envoy configuration options
Better `skipIf` & `onExisting` support.
2020-12-10 18:54:31 +01:00
Tomaž Jerman
a2110b26db Improve envoy system values
Handle timestamps & user stamps.
2020-12-02 15:08:52 +01:00
Tomaž Jerman
3444ac3021 Rename conditional envoy processing property 2020-12-02 09:58:50 +01:00
Tomaž Jerman
561fb2f052 Fix envoy settings from multiple sources 2020-12-02 09:25:08 +01:00
Tomaž Jerman
22785ad10b Add conditional envoy processing for compose records 2020-12-01 14:23:12 +01:00
Tomaž Jerman
3a9891431d Fix compose module field unmarshling; fix directory decoding 2020-12-01 10:27:58 +01:00
Denis Arh
4b0031fd81 Add support in YAML decoders for module field expr 2020-11-30 21:42:08 +01:00
Denis Arh
0cd101cdd6 Comment typos fixed 2020-11-30 20:27:10 +01:00
Denis Arh
b0f0e8fa60 Add channel name as envoy resource identifier
This will prevent creation of chan dups
2020-11-30 20:24:41 +01:00
Denis Arh
0465a635f5 Fix directory decoding 2020-11-30 19:51:18 +01:00
Denis Arh
d89450ae39 Ported messaging provision to envoy 2020-11-30 19:51:18 +01:00
Tomaž Jerman
5f3efdbfe6 Allow resource reference constraints
This lets us import multiple different namespaces with modules, ...
at the same time.

Before, there was a chance that a thing from NS 1 would be linked
to a thing in NS 2.
2020-11-30 18:51:46 +01:00
Tomaž Jerman
bcec07f8ff Fix reference field data types
From uint64 -> string.
2020-11-28 14:07:19 +01:00
Tomaž Jerman
b82f280a89 Allow compose record shaping to work without keys 2020-11-27 18:59:25 +01:00
Tomaž Jerman
eb2d98cbf0 Allow simple interaction with record encoder
Mainly used for record importer; might rework/remove at a later
point.
2020-11-27 18:59:25 +01:00
Tomaž Jerman
851a9a7e11 Tweak content type determination for resource decoders 2020-11-27 18:59:25 +01:00
Tomaž Jerman
9ad4a29d34 Remove flaky jsonl tests 2020-11-27 11:19:16 +01:00
Tomaž Jerman
21b11198ef Extend shaping integration tests for jsonl 2020-11-27 11:19:16 +01:00
Tomaž Jerman
a0b7716244 Shaping tests & post tweaks 2020-11-27 11:19:16 +01:00
Tomaž Jerman
10b300328d Implement data shaping
Unstructured datasources (csv, jsonl, ...) are defined as resource
datasets.
These datasets are then "shaped" based on some template.

The result is an envoy resource like any other.
2020-11-27 11:19:16 +01:00
Tomaž Jerman
7ca422bdd3 Remove deprecated decoder things
* loader interface,
* needless FileInfo.
2020-11-27 11:19:15 +01:00
Tomaž Jerman
8b6b322c1b Move envoy tests under integration tests 2020-11-27 11:19:15 +01:00
Tomaž Jerman
72ac5fa2ac Add a provision testcase 2020-11-27 11:19:15 +01:00
Tomaž Jerman
9aa968e36a Rename tests/main go 2020-11-27 11:19:15 +01:00
Tomaž Jerman
72c1885ee8 Small file ext tweak 2020-11-27 11:19:15 +01:00
Tomaž Jerman
f5ee8419d0 Define NextInverted on the graph 2020-11-27 11:19:15 +01:00
Tomaž Jerman
93a081d46c Cleanup old tests; post test tweaks 2020-11-27 11:19:15 +01:00
Tomaž Jerman
ebfca604f0 Add compose record tests & post test tweaks 2020-11-27 11:19:15 +01:00
Tomaž Jerman
09d679fba7 Add base tests & post test tweaks 2020-11-27 11:19:15 +01:00
Tomaž Jerman
0bcd620a18 Improve errors; post tweaks 2020-11-27 11:19:15 +01:00
Tomaž Jerman
892c7dfe3c Tweak resource finding logic 2020-11-27 11:19:15 +01:00
Tomaž Jerman
02620c4ea7 Tweak encoding routines 2020-11-27 11:19:15 +01:00
Tomaž Jerman
31c672e2e4 Implement base store encoder states 2020-11-27 11:19:15 +01:00
Tomaž Jerman
651c93fecb Cleanup, rename, restructure core envoy bits 2020-11-27 11:19:15 +01:00
Tomaž Jerman
a40f936f37 Yaml decoder tweaks based on resources & store 2020-11-27 11:19:15 +01:00