Kafka to hdfs3 sink Missing required configuration “confluent.topic.bootstrap.servers” which has no default value

Question

Status

My HDFS was installed via ambari, HDP. I\'m Currently trying to load kafka topics into HDFS sink. Kafka and HDFS was installed in the same machine x.x.x.x. I did

Answer 1

Here's the error:

Missing required configuration "confluent.topic.bootstrap.servers" which has no default value.

The problem is that you've taken the config for the HDFS Sink connector, and changed the connector for a different one (HDFS 3 Sink), and this one has different configuration requirements.

You can follow the quickstart for the HDFS 3 sink connector, or fix your existing configuration by adding

confluent.topic.bootstrap.servers=10.64.2.236:6667
confluent.topic.replication.factor=1

Note: in your example you missed the s from confluent.topic.bootstrap.servers which is why it didn't work