apache-zookeeper

How to design a system that can manage configurations in a dynamic way efficiently?

我们两清 提交于 2020-08-10 19:34:30
问题 I am working on designing a system where I need to manage configuration (config files) in a dynamic way across bunch of application servers. I am working with Consul key value store to manage configurations. I created below node in consul kv store for the purpose of managing configurations. {"remoteConfig":"abc-123.tgz", "...."} Here remoteConfig contains the config file that all the app servers will use (atleast this is the design I got). Below is what I am trying to do: All the app servers

HBase Error IllegalStateException when starting Master: hsync

守給你的承諾、 提交于 2020-08-05 19:21:00
问题 I'm trying to install HBase on a hadoop cluster and can't figure out why the HMaster fails to initiate when called from start-hbase.sh. The log files indicate an issue with hsync. I have confirmed that zookeeper is running correctly in distributed mode,and I have not had any issues working with the hadoop cluster through spark. When attempting to start HBase the region servers start on all data nodes. I have hadoop version 3.0.0, zookeeper 3.4.11 and hbase 2.0.0 beta 1. I have cleared out the

HBase Error IllegalStateException when starting Master: hsync

痞子三分冷 提交于 2020-08-05 19:20:53
问题 I'm trying to install HBase on a hadoop cluster and can't figure out why the HMaster fails to initiate when called from start-hbase.sh. The log files indicate an issue with hsync. I have confirmed that zookeeper is running correctly in distributed mode,and I have not had any issues working with the hadoop cluster through spark. When attempting to start HBase the region servers start on all data nodes. I have hadoop version 3.0.0, zookeeper 3.4.11 and hbase 2.0.0 beta 1. I have cleared out the

how to remaine the kafka retentions-bytes and kafka retention-segment even after kafka machine reboot [duplicate]

ぃ、小莉子 提交于 2020-08-05 07:52:45
问题 This question already exists : kafka + how to set specific retention byets for specific topic as permamnet Closed 12 days ago . we set retention bytes value - 104857600 for topic - topic_test [root@confluent01 ~]# kafka-topics --zookeeper localhost:2181 --alter --topic topic_test --config retention.bytes=104857600 WARNING: Altering topic configuration from this script has been deprecated and may be removed in future releases. Going forward, please use kafka-configs.sh for this functionality

Consumer and producer failing with error: “Connection to 0 was disconnected before the response was read”

安稳与你 提交于 2020-07-20 11:07:08
问题 I have a cluster of 3 Kafka brokers with replication factor of 3 for all topics. Since last few days I am facing this issue, suddenly(few times in a day) consumers and producers are stuck while getting response even when Kafka is running on all 3 servers which gets resolved until I check brokers logs ("Connection to 0 was disconnected before the response was read")and find out the culprit node which is 0 (1st node in this case)and restarts zookeeper and broker on that node. As per logs it is

Classpath is empty. Please build the project first e.g. by running './gradlew jar -PscalaVersion=2.11.12'

风流意气都作罢 提交于 2020-07-18 08:47:51
问题 I am not able to run a Apache Kafka service due to a failure while trying to start a Zookeeper instance. I have downloaded and tried it with all 3 availabe downloads at the official site. (binarys and source) When i try to start zookeeper with ./bin/zookeeper-server-start.sh config/zookeeper.properties I always get the same error message: Classpath is empty. Please build the project first e.g. by running './gradlew jar -PscalaVersion=2.11.12' The same goes for (after starting a seperate