A cross tenant metadata driven processing framework for Azure Data Factory and Azure Synapse Analytics achieved by coupling orchestration pipelines with a SQL database and a set of Azure Functions.

- Overview
- Contents

View the Project on GitHub mrpaulandrew/procfwk

Functions (Azure)


Azure Functions Icon Azure Functions provide the middle ware in the processing framework allowing the orchestration Data Factory pipelines to interact with the worker pipelines or access external resources.

The highly scalable, cheap, serverless compute provides the required customisations to extend the framework and acheive a level of decoupling between orchestration resources as well as supporting its own authenticate to Key Vault when needed.

All the Functions within the processing framework are created using:

Code Icons

Managed Service Identity (MSI)

MSI Enabling the Azure Function App is optional if you want to store worker pipeline SPN details in Azure Key Vault.