azure-data-factory

来源： https://stackoverflow.com/questions/48165947/access-datalake-from-azure-datafactory-v2-using-on-demand-hd-insight-cluster

问题 I need to send request to API over Azure Data Factory. But input parameter is file. How can i do this? 回答1: Data Factory Web Active can help you achieve that. It depends on where the file location is. For example, if your parameter file is stored in Blob Storage. We can set the filename as dataset parameter: Then set pipeline parameter filename : Web active settings: Set dataset filename = @pipeline().parameters.filename We can not pass a file as parameter directly, but we could parameter the

问题 Not able to get optionset string from Dynamics CRM to SQL Server using Azure data factory. I am using Azure data factory to move data from Dynamics CRM to SQL DB. I used fetchXML query to get the data from source (CRM). I am able to get normal string and guid type values without any issue. But the optionset field from CRM is coming as Int32 type (ie, I am getting the value of optionset, not the string). How can I fix this issue? 回答1: Probably you are using this approach to get the fetchxml

问题 I want to test a string value in Azure data factory. Based on this String value my pipeline would get trigger. I am collecting this value as a parameter from automation runbook. If the parameter value is "Nike" then Nike pipeline will trigger and else some other pipeline. The If condition having two options- True Activity False Activity so if the parameter does not match with a specified value then my false block would get trigger. But I have multiple values hence True/False condition will

问题 I want to test a string value in Azure data factory. Based on this String value my pipeline would get trigger. I am collecting this value as a parameter from automation runbook. If the parameter value is "Nike" then Nike pipeline will trigger and else some other pipeline. The If condition having two options- True Activity False Activity so if the parameter does not match with a specified value then my false block would get trigger. But I have multiple values hence True/False condition will

问题 I want to test a string value in Azure data factory. Based on this String value my pipeline would get trigger. I am collecting this value as a parameter from automation runbook. If the parameter value is "Nike" then Nike pipeline will trigger and else some other pipeline. The If condition having two options- True Activity False Activity so if the parameter does not match with a specified value then my false block would get trigger. But I have multiple values hence True/False condition will

问题 I'm trying to move data from a datalake stored in Azure Data Lake Storage Gen1 to a table in an Azure SQL database. In Data Factory "new Linked Service" when I test the connection I get a "connection failed" error message, "Access denied...make sure ACL and firewall rule is correctly configured in the Azure Data Lake Store account. I tried numerous times to correct using related Stack overflow comments and plethora of fragmented Azure documentation to no avail. Am I using the correct approach

问题 How do I pass in parameters at runtime to a Linked Service in Data Factory? I have a parameter defined and consumed in my Azure Function linked service definition, but am unsure how I set that during invocation in my pipeline action. In this case I would like to set functionAlias in a trigger to set the Azure Function hostname. Currently an exception is returned on (blob create) trigger stating that functionAlias is not specified. Pipeline { "name": "myActivity", "type":

问题 Im working with Data actory this time this why i ask lot of question about that My new problem is that my SOURCE(CSV file contains a column DeleveryDate full of Date dd/MM/YYYY) and my table SQl where i specify DElevry date as DateTime but when I map btw source and sink in Data preview source duplicate columns like in the picture below but in data preview sink the columns always NULL the same in my table NULL. Thanks 回答1: You said column DeleveryDate full of Date dd/MM/YYYY), can you tell me

问题 I have my data stored in blobs and I have written a python script to do some computations and create another csv. How can I execute this in Azure Data Factory ? 回答1: Mighty. You could use Azure Data Factory V2 custom activity for your requirements. You can directly execute a command to invoke python script using Custom Activity. Please refer to this sample on the github. Hope it helps you. 回答2: Another option is using a DatabricksSparkPython Activity. This makes sense if you want to scale out