azure-eventhub

My current setup is: Spark 2.3.0 with pyspark 2.2.1 streaming service using Azure IOTHub/EventHub some custom python functions based on pandas, matplotlib, etc I'm using https://github.com/Azure/azure-event-hubs-spark/blob/master/docs/PySpark/structured-streaming-pyspark-jupyter.md as an example on how to read the data but: can't use foreach sink as that is not implemented in python when i try to call .rdd, .map or .flatMap i get an exception: "Queries with streaming sources must be executed with writeStream.start()" What is the correct way to get each element of the stream and pass it through

I have an IoTHub with a route that points to an EventHub which triggers a Functions. I'm having problem getting the DeviceId and other IoT Hub properties from the event object without adding those explicitly to the payload. If I set the input type to a string (or a custom type): public static void Run(string iotMessage, TraceWriter log) { log.Info($"C# Event Hub trigger function processed a message: {iotMessage}"); } I only get the payload without any other IoT Hub properties like DeviceId , CorrelationId or MessageId . I tried to set the type to EventData instead: public static void Run

I am considering using Azure event Hub for a project I am currently working on. We are using Service Bus Queues for commands today and here we are using one queue per messagetype. Would it make sense to have several Event Hubs or is it better to use one hub for several message types? This is a question full of tradeoffs and exercising judgement about what systems you expect to build now and in the future and how they might use the different event types. Below is an excerpt from some of the guidance Jay Kreps has given for designing systems on top of Apache Kafka which applies well to Event

I am looking high frequency scaling solution for SignalR. I am wondering if I can do it with Azure EventHub. If I use EventHub as my backplane for SignalR messages, will it become a bottleneck for me? I've checked this page but there is nothing about EventHub as it is fairly new. I can't speak to the precise specifics of SignalR; however, you could in principle use EventHubs for a backplane, but you need to be aware of the limitations. SignalR's backplane scaleout pattern assumes that all the servers will have access to all the messages and presumptively process them all. This provides a

The application uses .NET 4.6.1 and the Microsoft.Azure.ServiceBus.EventProcessorHost nuget package v2.0.2 , along with it's dependency WindowsAzure.ServiceBus package v3.0.1 to process Azure Event Hub messages. The application has an implementation of IEventProcessor . When an unhandled exception is thrown from the ProcessEventsAsync method the EventProcessorHost never re-sends those messages to the running instance of IEventProcessor . (Anecdotally, it will re-send if the hosting application is stopped and restarted or if the lease is lost and re-obtained.) Is there a way to force the event