o DATA STORES (Flat files, RDBMS, Cloud Databases, Big Data / Hadoop):
-
RELATIONAL DATABASE support for multi-model incremental
harvesting.
Large database servers containing multiple schemas (e.g. Oracle,
Teradata, etc.) or multiple database instances (e.g. Microsoft SQL Server) are
now imported as multiple models (e.g. one model per schema or database instance)
with support for incremental harvesting (e.g. only updated or new schemas are
imported while unchanged schemas are reused from the harvesting cache). For
backward compatibility, databases are still imported as single models by
default, multi model is achieved with the Miscellaneous option -model.split
(previously -multiModel). Therefore, single large model database import is
officially deprecated with this version but still supported, however it will be
removed only at the next major release.
-
DATA CATALOGING OF THE DATA LAKE on local file servers (POSIX file
systems), over the cloud (e.g. Amazon S3), on big data clusters (e.g. Hadoop
distributions), on messages databases (e.g. Kafka), or on NoSQL databases (e.g.
MongoDB):
with high level data lake directory inventory import bridges
such as:
· Confluent Kafka Schema Registry import bridge
· Microsoft Azure Data Lake Storage Gen2 import bridge
o DATA INTEGRATION (DI/ETL/ELT/Scripts):
- New bridges:
· Amazon Web Services (AWS) Glue ETL (via Apache Spark) import bridge
· Databricks Unified Data Services (via Apache Spark) import bridge
· Denodo Virtual DataPort import bridge
· Informatica Data Engineering Integration (DEI) / Big Data Management (BDM) Developer import bridge
· Microsoft Azure Data Factory import bridge
· Snowflake Database SQL DML (DI/ETL) Script (SnowSQL) import bridge
o BUSINESS INTELLIGENCE (BI/OLAP):
- New bridges:
· (Google) Looker import bridge
· Microsoft Power BI (PBIX or PBIT) File (PowerQuery M language based) import bridge
o GENERAL:
- All Third-Party & Open Source Software have been upgraded to their latest versions for better security vulnerability protection.