azure-eventhub

I have events of different types. For example, some data is telemetry data, some is error information etc. I thought it would be a good idea to create several IEventProcessor implementations, one for each event type. So each implementation will handle the event differently. Like writing to file or to database. What's the best way to route events to a specific EventProcessor? Should I let an EventProcessor monitor a specific partitionkey and if so, how? Should I use the constructor of the EventProcessorHost that lets me specify a consumergroupname? If so, how can I send to a specific

I'm using a service which outputs to an Event Hub. We want to store that output, to be read once per day by a batch job running on Apache Spark. Basically we figured, just get all messages dumped to blobs. What's the easiest way to capture messages from an Event Hub to Blob Storage? Our first thought was a Streaming Analytics job, but it demands to parse the raw message (CSV/JSON/Avro), our current format is none of those. Update We solved this problem by changing our message format. I'd still like to know if there's any low-impact way to store messages to blobs. Did EventHub have a solution

For Azure event hub 1 though put unit equals 1MB/sec ingress. So it can take 1000 messages of 1 KB. If I select 5 or more throughput units would I be able to ingest 5000 messages/ second of 1KB size with 4 partitions? What would be egress in that case? I am not sure about limitation on Event Hub partition, i read that it is also 1MB/sec. But then does that mean to use event hub effectively i need to have same number of partitions? Great Qstn! Few Basics 1 ThruPut Unit (hereby, I will call TU) - means 1 MB/Sec or 1000msgs/sec - whichever happens first. You pay for TU's => you can change TUs as

We include dates in the events sent to our hub. Whenever I connect a new Azure Function to our Event Hub with a new consumer group, it seems to receive all events ever sent to the hub. This is somewhat expected, however I set the Message Retention on the hub to 1 day, so I expected at most to receive one day worth of events for the new consumer, but it seems to receive all events, even months old events, based on the date within the message, and lots more events than we generate over a day. Based on this page: https://blogs.msdn.microsoft.com/servicebus/2015/03/09/data-retention-in-event-hubs/

I'm building an azure web application, I'd like to send the activity logs to Azure Event Hub. What happen if the connection between the application host and the event hub is lost? Does the Event Hub client implement some kind of local queue? TLDR: Yes. EventHubs Offers atleast-once delivery. No queue is maintained by EventHub client SDK. It will throw and the dependent App will need to retry the Send. EventHubs service guarantees atleast-once delivery. The send call will succeed only when client receives 'acknowledgement" from the EventHubs Service. EventHubs service will not wait for the

I'm trying to solve for having thousands of IoT devices deployed, all logging events to Azure IoT hub, then being able to read events created by a single deviceid only. I have been playing with EventProcessorHost to get something like this working, but so far I can only see a way to read all messages from all devices. Its not a feasible solution to read all the messages and filter client side as there may be millions of messages. The major purpose of the Azure IoT Hub is an ingestion of mass events from the devices to the cloud stream pipeline for their analyzing in the real-time manner. The

I'm trying to send messages to Azure Event Hub using python and the rest API after some failed experiments i have found working code (see below) but i want to be able to select to which partition to send the event. Is this possible using the rest API and if so how should be done? #!/user/bin/python import json from datetime import datetime from multiprocessing import Pool # from azure.servicebus import _service_bus_error_handler from azure.servicebus.servicebusservice import ServiceBusService, ServiceBusSASAuthentication from azure.http import ( HTTPRequest, HTTPError ) from azure.http