azure-batch

Unusable Compute Node in Batch pool

由 时光总嘲笑我的痴心妄想 提交于 2019-12-12 16:58:38
问题 I am trying to create a pool with an application package installed on all nodes, however I keep getting that the compute nodes are unusable . My guess was that there was an error with the installation of application packages that caused the nodes to go to the unusable state. But then I got confused as I am able to install the same application packages at a task level in another pool. What could possibly be the problem? What causes the nodes to go to unusable state? And if my guess was right,

How to authenticate with Azure Analysis Services from Azure batch and data factory

由 丶灬走出姿态 提交于 2019-12-12 09:14:26
问题 I have a c sharp class library that connects to Azure Analysis Services using the AMO library. I'd like to use this as part of my data factory pipeline to refresh cube partitions. This is done through Azure batch as a custom .net activity. var server = new Server(); server.Connect("Provider=MSOLAP;Data Source=asazure://uksouth.asazure.windows.net/abcd;Initial Catalog=xyz"); Running this locally works fine, however this will not run in the cloud. It currently errors out as it is not being run

Azure Batch - Setting custom user identity for tasks

由 末鹿安然 提交于 2019-12-12 02:25:04
问题 I am using Azure Batch C# Client API 6.1. I am trying to have all my runs using the same user identity. I am setting a custom user identity as below, as per MSDN documentation. var task = new CloudTask("{guid}", "command string") { DisplayName = "display name", UserIdentity = new UserIdentity("customUserid") } However when the job runs, the task executes under a random user account. Would anyone know how to make it work OR even if it is supported by the backend Azure Batch service? Thanks in

How to silently get access token to user subscription Azure Batch?

由 醉酒当歌 提交于 2019-12-12 01:50:01
问题 i am working on project, where we have service that run computation on Azure Batch in user subscription mode (because we are using custom image). I have now my code fully working, but it requires every launch to provide user credentials to log into Azure Active Directory app before it can create Batch pools and so on. Because it will run as background service, i need to log in silently with some provided user without popup asking user to log in. I have registered native app in Azure and set

Azure Batch-Shipyard: create VMs inside a VNET, unusable status

由 自作多情 提交于 2019-12-11 17:56:14
问题 I am having issues using Azure Batch-Shipyard to create a set of VMs inside a VNET. Here is my configuration: Storage account ( mystorage ) allows only access from myvnet/mysubnet : storage and VNET configuration Batch account creates VMs inside this exact same VNET myvnet/mysubnet (using arm_subnet_id ) VNET myvnet/mysubnet is associated to Network Security Groups that allows TCP traffic on ports 29876-29877 from any source to any destination as detailed in Batch-Shipyard documentation: NSG

Azure batch - run multiple commands from command line on linux VM

由 我与影子孤独终老i 提交于 2019-12-11 15:55:05
问题 At the beginning, I created a pool with the following configuration: "Publisher": "microsoft-ads" "Offer": "linux-data-science-vm" "Sku": "linuxdsvm" Then I want "start.sh" file to be copied and run on VM. So, I need to change permissions, to allow execution of start.sh and then execute it. chmod +x start.sh && ./start.sh When I run it manually from terminal it works. But Azure Batch writes the following in the stderr.txt: chmod: cannot access '&&': No such file or directory Is there some way

Unable to run tasks on Azure Batch:Nodes go into unusable state after starting-up

由 混江龙づ霸主 提交于 2019-12-11 12:47:19
问题 I am trying to parallelize a Python App using Azure Batch.The workflow that I have followed in the Python client-side script is: 1) Upload Local files to Azure Blob Container using blobxfer utility (input-container) 2) Start Batch service to Process the files in input-container after logging in using the service principal account with azure-cli. 3) Upload the files to output-container through the python app distributed across the Nodes with Azure Batch. I am experiencing a problem very

How to pass application path to task in Azure batch

由 血红的双手。 提交于 2019-12-11 08:45:35
问题 I am using Azure batch. I have an exe which I need to execute on compute nodes. I am using this path in the azure portal in my task window "cmd /c %AZ_BATCH_APP_PACKAGE_MyAppCreateRG%\CreateRG.exe -args HelloRG eastUs" But I am getting an error: The system cannot find the path specified. 回答1: For your issue, the error you got is the core point of your problem. You can create a task with the command cmd /c "echo %AZ_BATCH_APP_PACKAGE_MyAppCreateRG%" to show the exact path if it exists or not.

Azure Batch Pool Start up task to download resource file from Blob FileShare

由 ♀尐吖头ヾ 提交于 2019-12-11 06:17:54
问题 I'm new to Azure, and I'm trying to build a simple Azure batch case here. I'm stacking at the Batch Pool Start up task... I created a batch account and a storage account in East US, and then I created a general -- Fileshare in the storage account with a container. I manually updated a file called Test.txt. What I want to do is to ask the Batch Pool to download this file at the startup task. So Code goes: string storageConnectionString = String.Format("DefaultEndpointsProtocol=https

Custom Image under AzureBatch ImageReference class not working

由 允我心安 提交于 2019-12-08 11:54:24
I have a custom VHD file with me. I am able to create Pool with my custom image through portal. But i want to try the same with .Net SDK. But it is throwing error "Operation returned an invalid status code 'Forbidden". I am referring this link Azure Batch I am able to create Pool from MarketPlace images from same code Below is my code ImageReference imageReference = new ImageReference("/subscriptions/XXXXXXXXXXXXXXX/resourceGroups/RG-OneGolden/providers/Microsoft.Compute/images/OMGoldenImage"); VirtualMachineConfiguration virtualMachineConfiguration = new VirtualMachineConfiguration(
订阅 azure-batch