Kafka producer to read data files

前端 未结 7 595
傲寒
傲寒 2021-02-02 04:14

I am trying to load a data file in loop(to check stats) instead of standard input in Kafka. After downloading Kafka, I performed the following steps:

Started zookeeper:<

7条回答
  •  温柔的废话
    2021-02-02 04:48

    Below command is ofcourse the easiest way to do that.

    kafka-console-producer --broker-list localhost:9092 --topic test < message.txt
    

    But sometimes it is not able to find the file. example :

    C:\kafka_2.11-2.4.0\bin\windows>kafka-console-producer.bat --broker-list localhost:9092 --topic jason-input < C:\data\message.txt
    

    you given the actual path but it is not able to find C at the current location so it will give the error : file not found. We would be thinking that we have given the actual path so it will go to root and it will start the path from there but it is finding the C(root) at the current place.

    Solution for that is to give the ..\ into the path to move to the parent folder. for example. you are executing the command like

    C:\kafka_2.11-2.4.0\bin\windows>kafka-console-producer.bat --broker-list localhost:9092 --topic jason-input < ..\..\..\data\message.txt
    

    as of now i am into the windows folder. ..\ will move the current directory to bin folder and again ..\ will move the current directory to the kafka.... folder and again ..\ will move to the C:. so now my path starts. data and then message.txt

提交回复
热议问题