DeforaNetworks/corteza
3
0
Fork 0
Code Activity
3,769 Commits 2 Branches 228 Tags
b5267bcbf9b4bf6dfb2e1de43a6098faf773783f
Commit Graph

36 Commits

Author SHA1 Message Date
Denis Arh
345eee72cb Various DAL codebase improvements and cleanups 2022-08-10 21:38:04 +02:00
Denis Arh
df97fb676b Improve handling modules with issues 
Allow adding incomplete (no or invalid connection) to DAL service
to avoid crashes.
 2022-08-09 20:29:50 +02:00
Denis Arh
1ac06a374b Ignore modules with invalid connection ID 2022-08-08 13:54:44 +02:00
Denis Arh
cbfb1d49bd Refactor model ident validation 2022-08-08 13:25:32 +02:00
Denis Arh
015d8ada6e Refactor module-model conversion 
Remove redundant parts of config (eg partititoned flag),
refactored and cleand-up field-to-attribute conversion
 2022-08-08 13:19:01 +02:00
Tomaž Jerman
9e1375e99a Refactor DAL capabilities into operations and properties 2022-08-02 12:57:22 +02:00
Denis Arh
7d91b4eaaf Improve error message when database is misconfigured 2022-07-28 19:57:28 +02:00
Denis Arh
34c767127f Fix DAL terminology (remove "record") 2022-07-28 14:16:01 +02:00
Denis Arh
55b4f4ece7 Remove wrapError utility func 2022-07-28 13:02:15 +02:00
Denis Arh
98722f67eb Rename ModelFilter to ModelRef 2022-07-28 12:58:40 +02:00
Denis Arh
f725624697 Move DAL iterator interface and add IteratorEncodeJSON 2022-07-28 11:04:56 +02:00
Tomaž Jerman
978c538748 Make DAL Purge method not remove the primary store since its invalid 2022-07-27 16:53:04 +02:00
Tomaž Jerman
db4bdbe4ba Make DAL sensitivity level removal graceful 
It does not error out if it does not exist like with other
resources.
This makes it more consistent and easier to work with in tests.
 2022-07-27 16:53:04 +02:00
Vivek Patel
fad8725a63 Fix sensitive level check for data privacy modules 
A module have one or more module field with have a sensitivity level then it will consider as private module.
 2022-07-26 09:30:59 +05:30
Denis Arh
294d502786 Ensure default connection use finding DAL models 2022-07-21 08:37:52 +02:00
Tomaž Jerman
1d5232fc75 Make DAL model management more consistent, deprecate most dalutils 2022-07-18 18:53:11 +02:00
Vivek Patel
56a7bfa821 Add route for listing sensitive modules 
It will list out all the privacy related modules, that have one or more private fields.
 2022-07-18 17:24:37 +05:30
Tomaž Jerman
85bb86c5cd Refactor sensitivity levels to be consistent with connections 2022-07-15 11:02:14 +02:00
Denis Arh
2b87ef2577 Fix record service tests 2022-07-03 12:19:48 +02:00
Denis Arh
bdd9318f93 Refactor and improve DAL implementation and init 
Changes:
 - Boot initialization follows standard impl
 - Improved DAL connection management (adding, reloading, removing)
 - Cleaner and more detailed logging
 - Primary store connection is now reused when added to DAL
 2022-07-01 18:13:54 +02:00
Tomaž Jerman
2afd806c2e Allow sensitive data collection to filter by connectionID 2022-06-14 20:35:42 +02:00
Tomaž Jerman
319ae7e375 Fix improper sensitivity level check when removing attributes 2022-06-14 20:35:42 +02:00
Tomaž Jerman
9adced7a1e Fix attribute panic when adding/removing attributes 2022-06-14 20:35:42 +02:00
Tomaž Jerman
557a573f04 Add base DAL tests 2022-06-14 20:35:42 +02:00
Tomaž Jerman
8eb062293f Refactor pkg/dal implementation 
* Reworked errors to not brick the system (things keep track of
  issues.
* Reworked internal state management -- keeping invalid things
  present, cleanning up the code, utilizing issues.
* Cleanup/improve error messages
 2022-06-14 12:06:13 +02:00
Tomaž Jerman
c6b26c4e32 Temporary patch for primary connection updating 2022-05-31 13:16:14 +02:00
Tomaž Jerman
a70087ace8 Refactor primary DAL connection to be preserved in DB 2022-05-30 15:43:03 +02:00
Tomaž Jerman
a0a6314ea9 Introduce DAL model ident formatter to simplify the interfaces 2022-05-26 17:41:15 +02:00
Tomaž Jerman
9223feac95 Omit sensitivity level inclusion check when omitted 2022-05-26 15:12:20 +02:00
Tomaž Jerman
94fbe4bd44 Improve DAL sensitivity level 
* Integrate with pkg/dal package
* Additional validation/constraints
 2022-05-26 13:24:16 +02:00
Tomaž Jerman
ac07f133b5 Expand DAL REST API structure and exposed resources 
* Cleanup DAL connection REST endpoints, remove primary connection
  endpoint.
* Make connection search endpoint return federation nodes and
  primary connection along user-defined DAL connections
* Expose DAL connection drivers
* Prepare DAL sensitivity level resource
 2022-05-25 14:10:52 +02:00
Denis Arh
040ad02e75 Refactor and fix DAL tests 
DAL tests are now moved to /tests/dal
 2022-05-22 19:07:44 +02:00
Tomaž Jerman
b85f16a368 Add slight structure rename, add supporting services 
* Add system connection CRUD & service
* Simplify compose type definitions
 2022-05-20 15:37:33 +02:00
Tomaž Jerman
cda3c80c74 Connect the remaining record svc CRUD operations to DAL 2022-05-20 15:37:33 +02:00
Tomaž Jerman
81dda274eb DAL service refactor & RDBMS interface tweak 
* Remove Compose service related bits out of the DAL service
* Minor DB connectivity tweaks and include capabilities
* Add values column to the compose_record table
* Compose types tweaks
 2022-05-20 15:37:33 +02:00
Denis Arh
671a51f9f7 Refactor and renamed CRS implementation to DAL 2022-05-20 15:37:33 +02:00