Kafka 1.0 stops with FATAL SHUTDOWN error. Logs directory failed

Question

I have just upgraded to Kafka 1.0 and zookeeper 3.4.10.At first, it all started fine. Stand - alone producer and consumer worked as expected. After I\'ve ran my code for abo

Answer 1

Just clean the logs in C:\Kafka\kafka_2.12-1.0.0\kafka-logs and restart kafka

Answer 2

reinstall zookeeper can resolve this problem.

Answer 3

If at all, you are trying to execute in Windows machine, try changing path in windows way for parameter log.dirs (like log.dirs=C:\some_path\some_path_kafLogs) in server.properties in /config folder.

By default, this path will be in unix way (like /unix/path/).

This worked for me in Windows machine.

Answer 4

So this seems to be a windows issue.

https://issues.apache.org/jira/browse/KAFKA-6188

The JIRA is resolved, and there is an unmerged patch attached to it.

https://github.com/apache/kafka/pull/6403

so your options are:

• get it running on windows and build it with the patch
• run it in a unix style filesystem (linux or mac)
• perhaps running it on docker in windows is worth a shot

Answer 5

I've tried all the solutions like

• Clearing Kafka Logs and Zookeeper Data (issue reoccurred after creating new topic)
• Changing log.dirs path from forward slash "/" to backward slash "\" (like log.dirs=C:\kafka_2.12-2.1.1\data\kafka ) folder named C:\kafka_2.12-2.1.1\kafka_2.12-2.1.1datakafka was created and the issue did stop and the issue was resolved.

Finally I found this link, you'll get it if you google kafka log.dirs windows

Answer 6

Ran into this issue as well, and only clearing the kafka-logs did not work. You'll also have to clear zookeeper.

Steps to resolve:

1. Make sure to stop zookeeper.

2. Take a look at your server.properties file and locate the logs directory under the following entry.

   Example:
   log.dirs=/tmp/kafka-logs/
   

3. Delete the log directory and its contents. Kafka will recreate the directory once it's started again.

4. Take a look at the zookeeper.properties file and locate the data directory under the following entry.

   Example:
   dataDir=/tmp/zookeeper
   

5. Delete the data directory and its contents. Zookeeper will recreate the directory once it's started again.

6. Start zookeeper.

   <KAFKA_HOME>bin/zookeeper-server-start.sh -daemon <KAFKA_HOME>config/zookeeper.properties
   

7. Start the kakfa broker.

   <KAFKA_HOME>bin/kafka-server-start.sh -daemon <KAFKA_HOME>config/server.properties
   

8. Verify the broker has started with no issues by looking at the logs/kafkaServer.out log file.