azure-eventhub

问题 My architecture: 1 EventHub with 8 Partitions & 2 TPUs 1 Streaming Analytics Job 6 Windows based on the same input (from 1mn to 6mn) Sample Data: {side: 'BUY', ticker: 'MSFT', qty: 1, price: 123, tradeTimestamp: 10000000000} {side: 'SELL', ticker: 'MSFT', qty: 1, price: 124, tradeTimestamp:1000000000} The EventHub PartitionKey is ticker I would like to emit every second, the following data: (Total quantity bought / Total quantity sold) in the last minute, last 2mn, last 3mn and more What I

问题 I am using eventhub python sdk consumer for real time processing of the data from eventhub. I have currently 2 partitions of my topic. I would like to know about my consumer lag. I know what is the sequence number of the message I am processing, but cannot get the last sequence number enqueued in the event hub on a particular partition. If I can get this information, it will be very easy for me to find the lag for a particular partition. Can someone please help me how can I do this? 来源： https

问题 In my python application, if any bad/good event happens, I want to send the event details as notification message to user's email addresses or phone #s that have been subscribed to this application. So I am looking for publisher-subscriber model azure cloud Looks like multiple Azure services achieving similar goal but having a thin line of differences. Event hubs and notification hubs seems promising. So my question is as follows: Can email ID/phone # be subscribed to Azure event hub and

问题 I want to use Azure Eventhub as a middleware messaging queue. I am basically sending simulated data in list formats and receiving it in string format now. As you can see Here, there are only a few formats in which data is convertible. I want the format of data to be a list with float data in it. Here is the code that I am working on right now. I am trying to manipulate the line below to each event data in float form being accumulated in the list. LIST.append(event_data.message._body) This is

问题 According to documentation all non-static calls of EventHubClient are not thread-safe. This means that I cannot easily call the following function from wherever I want: public async Task SendBatchAsync(IList<EventData> eventHubBatch) { try { await this.eventHubClient.SendBatchAsync(eventHubBatch); } catch (Exception ex) { Console.WriteLine("ERROR (EH WRITER): {0}", ex.Message); } } Wonder what are the alternatives? Locking Sync thread context Save to some queue and have one threadpool-based

问题 I'm working with Azure Event Hubs and initially when sending data to try and calculate batch size I had code similar to the below that would call EventData.GetBytes EventHubClient client;//initialized before the relevant code EventData curr = new EventData(data); //Setting a partition key, and other operations. long itemLength = curr.GetBytes().LongLength; client.SendAsync(curr); Unfortunately I would receive an exception in the SDK code. The message body cannot be read multiple times. To

问题 So I have created an Event Hub using the new portal. When I visit the Event Hub blade and browse to the Metrics blade in the Monitoring section I get this chart: I wonder where I can find more info about these errors. Does anybody know? 回答1: Event Hubs can also emit Diagnostic Logs, which contain detailed diagnostic information on errors. See https://docs.microsoft.com/en-us/azure/monitoring-and-diagnostics/monitoring-overview-of-diagnostic-logs#how-to-enable-collection-of-diagnostic-logs for

问题 Following the EventProcessorHost example we implemented our custom logic in onEvents(). Some data is not being processed and I suspect this is because of the warnings thrown by the Java client. In the log we see StorageException (time-out on blob storage for renewing leases or checkpointing), LeaseLostException (probably due to the previous exception) and EventHubException (when event hub move or go offline for a short period). Basically my question is: How do these exceptions impact the

问题 Is there any sample code in C# for reading the Azure Event Hub Archive files (Avro format)? I am trying to use the Microsoft.Hadoop.Avro library. I dumped the schema out using a java avro tool which produces this: { ""type"":""record"", ""name"":""EventData"", ""namespace"":""Microsoft.ServiceBus.Messaging"", ""fields"":[ {""name"":""SequenceNumber"",""type"":""long""}, {""name"":""Offset"",""type"":""string""}, {""name"":""EnqueuedTimeUtc"",""type"":""string""}, {""name"":""SystemProperties"

问题 What is the best way to send data from Event Hubs to Data Lake Store? 回答1: I am assuming you want to ingest data from EventHubs to Data Lake Store on a regular basis. Like Nava said, you can use Azure Stream Analytics to get data from EventHub into Azure Storage Blobs. Thereafter you can use Azure Data Factory (ADF) to copy data on a scheduled basis from Blobs to Azure Data Lake Store. More details on using ADF are available here: https://azure.microsoft.com/en-us/documentation/articles/data