This diagram represents the data ingestion framework that uses libraries and Databricks notebooks in Azure. It takes JSON files as input (lineage + data catalogs) and runs data pipelines based on those configuration files. The framework also includes a connector for APIs and handles various data types.
Data Ingestion Framework Diagram
—
by