Denis Arh
3050cda023
Add RDBMS DAL model validation
...
This will prevent misconfigured models with atributes that read from the
same columns. This constraint could/should be removed in the
future.
2022-09-16 12:57:42 +02:00
Tomaž Jerman
077788d9b8
Remove operations from models and connections
...
For now, operations will be defined on a DB driver.
2022-09-15 13:55:21 +02:00
Tomaž Jerman
da24de8b09
Add attribute ident normalization to support legacy names
...
Older versions allowed more variations for the same system ident.
New one does not; normalization is a temporary solution for it.
2022-09-15 12:06:49 +02:00
Tomaž Jerman
9fdb86c4cf
Add date_format to supported QL functions
2022-09-15 12:06:49 +02:00
Denis Arh
d1dd4d1a0c
Support SQLite table & index creation
2022-09-14 12:18:43 +02:00
Denis Arh
44ba447678
Add support for meta data on attribute types (rdbms:type=integer)
2022-09-14 12:18:43 +02:00
Denis Arh
6939d9e226
Model definition fixes (dal, index)
2022-09-14 12:18:43 +02:00
Denis Arh
4e96804d46
Add support for RDBMS index creation
2022-09-14 12:18:43 +02:00
Denis Arh
5992471337
Add support for default values for RDBMS columns
2022-09-14 12:18:43 +02:00
Denis Arh
a6c0d8ecee
Base support for creating RDBMS tables from models
2022-09-14 12:18:43 +02:00
Tomaž Jerman
7d18058f58
Rework the cmpose report endpoint to the DAL pipeline
2022-09-14 10:17:22 +02:00
Peter Grlica
7f0fe201db
Deprecated Corteza plugin support
...
The current plugin support was not stable enough in go >= 1.18, so the
current implementation was dropped for a future alternate solution.
2022-09-13 10:57:42 +02:00
Tomaž Jerman
8ac3b50077
WIP/POC pkg for common gval handlers
2022-09-01 16:55:21 +02:00
Tomaž Jerman
319a29fdc6
Cleanup system/reporter - DAL/pipeline migration
2022-09-01 16:55:21 +02:00
Tomaž Jerman
4b65286df1
Add refs to DAL models constructed from compose modules
2022-09-01 16:55:20 +02:00
Tomaž Jerman
ccc1064fac
Expand test suite, cleanup/refactor based on results
2022-09-01 16:55:20 +02:00
Tomaž Jerman
7e0d55dfa1
Move step definition validators to the end
...
This allows the init to correct invalid/missing bits.
2022-09-01 16:55:20 +02:00
Tomaž Jerman
3f15fa2a82
Fix pkg/dal tests
2022-09-01 16:55:20 +02:00
Tomaž Jerman
625d4c2e0f
Update dal internal filter to conform to new interface
2022-09-01 16:55:20 +02:00
Tomaž Jerman
eb57c03e6c
Port the old system reporter to the DAL pipeline
2022-09-01 16:55:20 +02:00
Tomaž Jerman
b378b87313
Make pkg/dal.Row more robust
2022-09-01 16:55:20 +02:00
Tomaž Jerman
5fe71bf3b1
Tweak DAL pipeline preparation & exec flow
...
* Add a dryrun option; split init into init and exec
* move the iterator method from pipeline to service to allow
more context when preprocessing/initializing the pipeline
* add an extra value to link's right rows to simplify identification
2022-09-01 16:55:20 +02:00
Tomaž Jerman
dc70e2aeb8
Export dal.Row for reusability
2022-09-01 16:55:20 +02:00
Tomaž Jerman
377e07cbd9
Move dal attribute types to constants for reusability
2022-09-01 16:55:20 +02:00
Tomaž Jerman
9aba555179
Move pkg/report types to sys/types; drop pkg/report package
2022-09-01 16:55:20 +02:00
Tomaž Jerman
787d51e136
Move ASTNode merging methods to QL package
2022-09-01 16:55:20 +02:00
Tomaž Jerman
b6cb376d83
Introduce base model constraints and rework record filter constraints
2022-09-01 16:55:20 +02:00
Tomaž Jerman
1ad7323ce7
Define base dal pipeline implementation
2022-09-01 16:55:20 +02:00
Tomaž Jerman
f8595ca827
Implement pipeline link (left) execution step
2022-09-01 16:55:20 +02:00
Tomaž Jerman
bad80e5d81
Implement pipeline join (left) execution step
2022-09-01 16:55:20 +02:00
Tomaž Jerman
5b89af4e01
Implement pipeline aggregate execution step
2022-09-01 16:55:20 +02:00
Tomaž Jerman
f80a0b8107
Add an inmemory buffer for easier testing
2022-09-01 16:55:20 +02:00
Tomaž Jerman
a4c61d63ad
Add base testing boilerplate and generic utilities
2022-09-01 16:55:20 +02:00
Tomaž Jerman
a6abc01927
Outline base pipeline step definition and costing model
...
Pipeline step definitions are used to construct underlaying
execution nodes operate over datasources.
The costing model is the initial approach to provide optimizers
more context on what they should do.
2022-09-01 16:55:20 +02:00
Tomaž Jerman
40dbbae730
Add an internalFilter wrapping struct for filter.Filter
...
The struct simplifies filter manipulation when performing
analysis and optimization.
2022-09-01 16:55:20 +02:00
Tomaž Jerman
61051e998e
Define tester & evaluator interfaces for asserting/computing attrs
2022-09-01 16:55:20 +02:00
Tomaž Jerman
985c063d89
Expand pkg/filter for easier paging cursor construction/use
...
* Add a cursor method to return an ql.ASTNode representation.
* Add a package function to construct a cursor from an arbitrary
value input.
2022-09-01 16:55:20 +02:00
Tomaž Jerman
689be25a89
Cover ASTNode.String() nil ptr edgecase
2022-09-01 16:55:20 +02:00
Denis Arh
5d45846fdd
Prevent panic in locale/LocalizedList fn
2022-08-29 07:39:25 +02:00
Denis Arh
258068bdfb
Improve model-by-ref handling
2022-08-28 12:41:06 +02:00
Denis Arh
4bb8270189
Fix DAL implementation with Envoy
2022-08-23 08:12:38 +02:00
Tomaž Jerman
6799d3f8de
Fix global value store URL construction with custom paths
2022-08-22 15:59:49 +02:00
Peter Grlica
91252ac93d
Fixed apigw payload processer invalid function registration
2022-08-22 14:41:59 +02:00
Denis Arh
fb8765ff39
Improved default-connection handlong on module reload
2022-08-21 16:41:38 +02:00
Denis Arh
818f0ccb9b
Generate models for all resources
...
Some refactoring of CUE files
2022-08-21 15:54:03 +02:00
Denis Arh
554ae45ddf
Various DAL connection improvements & config reorg
2022-08-15 16:57:42 +02:00
Denis Arh
ff69698027
Properly implement model cache management on DAL RDMBS
2022-08-12 16:50:12 +02:00
Denis Arh
4f0d0ad6c1
Change compose record labels to meta
2022-08-11 19:33:07 +02:00
Denis Arh
345eee72cb
Various DAL codebase improvements and cleanups
2022-08-10 21:38:04 +02:00
Denis Arh
df97fb676b
Improve handling modules with issues
...
Allow adding incomplete (no or invalid connection) to DAL service
to avoid crashes.
2022-08-09 20:29:50 +02:00
