apache-bahir

Schema issue with ApacheBahir Stuctured Streaming connector on ApacheSpark streaming

眉间皱痕 提交于 2019-12-25 09:17:41
问题 I'm trying to hook-up an Apache Spark Structured Stream to a MQTT topic (IBM Watson IoT Platform on IBM Bluemix in this case). I'm creating the structured stream as follows: val df = spark.readStream .format("org.apache.bahir.sql.streaming.mqtt.MQTTStreamSourceProvider") .option("username","<username>") .option("password","<password>") .option("clientId","a:vy0z2s:a-vy0z2s-zfzzckrnqf") .option("topic", "iot-2/type/WashingMachine/id/Washer02/evt/voltage/fmt/json") .load("tcp://vy0z2s.messaging