Pyspark Failed to find data source: kafka

Question

I am working on Kafka streaming and trying to integrate it with Apache Spark. However, while running I am getting into issues. I am getting the below error.

This is the

Answer 1

I think you need to provide absolute path of jar file of kafka, at the time of spark-submit command, like below:

./bin/spark-submit --jars /path/to/spark-streaming-kafka-0-8-assembly_2.11-2.0.0.jar

You can download jar file from here. For detail information, refere this.