Yang Db Versions Save

Abstract:

The purpose of this branch is to integrate the E/S version 7.4.2 into yandDb

Changes:

Modularization:

• added AsgCypherModule

• added AsgGraphQLModule

• added AsgSparqlModule

• added AsgSqlModule

• added SQLModule

• added SparqlModule

• added CypherModule

• added GraphQLModule

• added CypherControllerRegistrar

• added GraphQLControllerRegistrar

• added SQLControllerRegistrar

• added SparQLControllerRegistrar

• added assembly unique deployment public

• add unique swagger file per deployment

Upgrade jooby version to 1.6.8

Upgrade Elasticsearch version to 7.4.2

Fixes:

Remove BasicIdGenerator.getNext() needs no version lock
Fix CSV-convertor to concider LOV (dictionary) when creating the json document

Features: - Added Ontology Based data ingestion in GraphDataLoader - Added Ontology Based indices creation in GraphInitiator - Add GraphAPI endpoint with access to activating findPath() API specific designated API - Adding mapping capabilities between logical & schematic ontologies - using AsgMappingStrategy which relies on MappingProvider - DataLoaderControllerRegistrar add mapping endpoints - DataLoaderControllerRegistrar add mapping endpoints - StandardDataLoaderController add API - Added Ability to translate DDL query to Ontology - using JooQ framework - workaround for ConstraintStatement / CreateTableStatement no parser access - Add projectedFields support for Query/AsgQuery - not yet fulfilled in API - Add directives support for Ontology - not yet fulfilled in API

Bugs:

• Add Typed/Untyped RelPattern to manage both typed & untyped end vertex (at the end of the internal relations )...

• Every Access to ontologyProvider is wrapped with orElseThrow if ontology not found

• Add fields() api to EntityType / Relationship to collect both mandatory and regular properties

• Change Folder providers to take ontology name from json content rather from file name

• PartitionFilteredRawSchema - remove internal check against Elastic Index existance

• Adding Profile able createCursor instruction in Cursor.createResource() for additional query profiling

• EnumType fix naming and conventions issue

• OntologyFinalizer fix auto adding of mandatory fields - only when not exist already

• Add IndexProvider Builder

• Add profiling concepts to cursor requests

  Modularization:

• added AsgCypherModule

• added AsgGraphQLModule

• added AsgSparqlModule

• added AsgSqlModule

• added SQLModule

• added SparqlModule

• added CypherModule

• added GraphQLModule

• added CypherControllerRegistrar

• added GraphQLControllerRegistrar

• added SQLControllerRegistrar

• added SparQLControllerRegistrar

• added assembly unique deployment public

• add unique swagger file per deployment

  Fix ES: - remove "_all" mapping
  - remove standard filter - fix ngram max-min diff

Upgrades:

Add support for retry using https://reflectoring.io/retry-with-resilience4j/

Refactorization:

• moved string constants to refer from GlobalConsts

• Complete re-factor for ElasticIndexProviderMappingFactory

  • add support for Nested / Embedded / Unified style schema mapping

• Complete re-factore for DataLoaderUtils

  • add support for ontology depended loading

• Complete re-factore for DefaultGraphInitiator

  • add support for ontology depended loading

This is a first "actual" release of the YangDb open source graph project that is based on Elasticsearch as the actual data & indexing layer

Features included:

• V1 language spec

• V1 Language grammer verification

• Cypher (partial) language spec

• Cypher (partial) Language grammer verification

• Execution plan builder

• Basic graph API such as findPath

• stored queries

• cursors per query

• paging per cursor

• REST API support

• Swagger

• GraphQL Transformations

• Results Projections

Much more ...

See https://www.yangdb.org/

Fix find Path API Fix Forward only cursor API

Add Elasticsearch additional log attributes Add ontology support for primitive (properties) search types explicit declaration Add cursor pattern printing for AssignmentResults for all cursors available Add runCypher with cursor type as parameter Add csv loader for knowledge ontology Add csv loader for client api Add bigDesk site

Merge LodicalModel branch into Dev

Add CountCursor Add Swagger API fixtures Add default Index for Indexing schema - fallback for id not in index range
Merge LogicalModel into dev

Fix Search Scroll issues for paging - revert back to Search scroll query run API:

• add cursorType
• add page size

Build: Development

Fix: KnowledgeRawSchemaShort - add parameterized for indices creation

• fuse.id_bulk
• fuse.id_format="%08d"
• fuse.indices_count=10

Hot fix:

• update Logical cursor to support non existing context metadata field - this is subject to future change