Orchestrate
.procfwk
A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration pipelines with a SQL database and a set of Azure Functions.
- Overview
- Contents
Datasets
The processing framework requires only one dataset for all activity operations. In the code repository this is called GetSetMetadata. This dataset offers all Lookup and Stored Procedure activities within the framework pipelines the ability to call and query the metadata database objects.
As the scope of the framework is to operate at the control flow level within a given solution, datasets used for data transformation are not within the remit of the framework project. However, if you are using a single orchestrator instance for both the framework pipelines and the worker pipeline processing tasks other datasets can be created as required.