A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration pipelines with a SQL database and a set of Azure Functions.

- Overview
- Contents

View the Project on GitHub mrpaulandrew/procfwk

Data Factory


Data Factory Icon Azure Data Factory is the primary resource within the processing framework solution for delivering both the execution of orchestration pipelines (Grandparent, Parent, Child, Infant) used to deliver this framework as well as worker pipelines created outside of the processing solution.

In the context of the processing framework Data Factory operates at the control flow level as an orchestrator for a given solution. Data flow level transformtion operations are not handled within the framework. It is expected that dataset level tasks are delivered by the worker pipelines that this framework executes.