Migration to Hierarchical Metadata

The earlier metamodel/profile for JSON was too limited and incomplete as it did not model both arrays and structures, and did not capture the root object which could be an array.  This situation has been corrected in the latest product.  This change has impact in many places both MIMB and MIMM.

In MIMB, JSON is used by almost all bridges except databases.

File System / Data Lakes

File System (Delimited, Fixed Width, Excel, XML, JSON, Avro, Parquet, ORC, COBOL Copybook)

AWS Simple Storage Service (S3) File System

Azure Data Lake Storage (ADLS) File System

Azure Blob Storage File System

Google Cloud Storage (GCS) File System

Kafka File System

Swift Object Store File System

NoSQL databases bvased on JSON

MongoDB

Azure Cosmos DB NoSQL Database

Cassandra

CouchDB

ETL/DI/BI bridges reading/writing JSON file based data stores

Data Mapping Script

any DI tool supporting hierrachies like Talend DI jobs (many stitched to JSON files)

Haddop HiveQL

In MIMM, JSON is also used with

Model Browser

Data Mapper

Data Flow

Configuration / Connection resolutions

And others.

In order to ensure proper migration and no loss of metadata and no loss of linking (documentation, mappings, stitching/data flow, etc.) this upgrade is performed automatically as part of the database upgrade to this latest version.