azure-data-factory-pipeline

问题 We have different ADF environments such as TST,UAT & prod. In each environment the self hosted IR name is different. Is it possible to parameterize the integration runtime in ADF ARM Template, so that when the ARM templates deploys through CI/CD we can pass IR name in the DevOps Variable group during the deployment. I have tried changing the Parametrization Template in ADF with below setting, but the IR name is still not available in the ARM template parameter JSON 'arm_template_parameters

问题 I have been following Microsoft's tutorial to incrementally/delta load data from an SQL Server database. It uses a watermark (timestamp) to keep track of changed rows since last time. The tutorial stores the watermark to an Azure SQL database using the "Stored Procedure" activity in the pipeline so it can be reused in the next execution. It seems overkill to have an Azure SQL database just to store that tiny bit of meta information (my source database is read-only btw). I'd rather just store

来源： https://stackoverflow.com/questions/64531318/will-adf-deployment-using-azure-devops-affect-existing-pipelines-jobs-in-the-env

来源： https://stackoverflow.com/questions/62944366/azure-data-factory-split-file-by-file-size