apache-zookeeper

How to calculate the number of zookeeper servers I need for a cluster?

核能气质少年 提交于 2020-01-24 12:13:06
问题 Is there a formula to calculate the number of zookeeper servers I need? Say a cluster may have 50, 500, or 5000 servers running, how do I convert those numbers into how many zookeeper server I want to start? To put it another way, what's a good estimate for the workload a zk server can handle? Is it based on the size of the storage, or QPS the quorum receives, or some other metrics? 回答1: The workload an ensemble (cluster) of ZooKeeper servers can handle, is primarily dependent on the number

Adding new ZooKeeper node in Kafka cluster?

时光毁灭记忆、已成空白 提交于 2020-01-24 11:44:07
问题 I have running an Apache Kafka cluster of five nodes, and I am using an Apache ZooKeeper cluster of three nodes. In zookeeper.properties file: server.1=zNode01:2888:3888 server.2=zNode02:2888:3888 server.3=zNode03:2888:3888 And in server.properties file: zookeeper.connect=zNode01:2181,zNode02:2181,zNode03:2181 I want to add a new ZooKeeper node: I need to add this new ZooKeeper IP to an existing ZooKeeper properties file and need to restart it OR there is another way to do it? I need to add

Adding new ZooKeeper node in Kafka cluster?

人走茶凉 提交于 2020-01-24 11:43:37
问题 I have running an Apache Kafka cluster of five nodes, and I am using an Apache ZooKeeper cluster of three nodes. In zookeeper.properties file: server.1=zNode01:2888:3888 server.2=zNode02:2888:3888 server.3=zNode03:2888:3888 And in server.properties file: zookeeper.connect=zNode01:2181,zNode02:2181,zNode03:2181 I want to add a new ZooKeeper node: I need to add this new ZooKeeper IP to an existing ZooKeeper properties file and need to restart it OR there is another way to do it? I need to add

Adding new ZooKeeper node in Kafka cluster?

倾然丶 夕夏残阳落幕 提交于 2020-01-24 11:43:26
问题 I have running an Apache Kafka cluster of five nodes, and I am using an Apache ZooKeeper cluster of three nodes. In zookeeper.properties file: server.1=zNode01:2888:3888 server.2=zNode02:2888:3888 server.3=zNode03:2888:3888 And in server.properties file: zookeeper.connect=zNode01:2181,zNode02:2181,zNode03:2181 I want to add a new ZooKeeper node: I need to add this new ZooKeeper IP to an existing ZooKeeper properties file and need to restart it OR there is another way to do it? I need to add

Reassignment replicas don`t match the list of replicas for Reassignment for partition

混江龙づ霸主 提交于 2020-01-24 00:17:09
问题 We have 6 kafka brokers in our cluster Brokers ids are - 1121 - 1126 We try to reassingmnet the first partition of topic - data-topic The first partition is - data-topic-0 But after Reassignment , and when we run the verification as kafka-reassign-partitions.sh --zookeeper zoo01:2181 --reassignment-json-file /tmp/file-partition.json --verify We get Reassignment replicas (1125,1124, 1126) don`t match the list of replicas for Reassignment (1125,1122,1123) for partition data-topic-0 Reassignment

Is there a way to add watcher queue in zookeeper?

我与影子孤独终老i 提交于 2020-01-22 19:09:06
问题 I am using node-zookeeper-client for java script as a zookeeper client. I have something like this: const setWatch = (path, functionToExecuteOnTrigger) => { client.getData(path, (event) => { // watcher set here functionToExecuteOnTrigger(event); }, null) // null because we are only setting watch here and do not need data } This function will set a watch at a path in the zookeeper. Once a watch is triggered, the watcher callback will be called and an appropriate function to be called on the

Error on zookeeper

别来无恙 提交于 2020-01-17 08:04:47
问题 I installed zookeeper on Ubuntu 14 but when run the command it fails. the command is: cat /var/log/kaa/* | grep ERROR it shows: 2017-04-19 00:20:04,197 [main] ERROR o.k.k.s.n.s.i.KaNodeInitializationService - Failed to connect to Zookeeper within 5 minutes. Kaa Node Server will be stopped. 2017-04-19 00:45:39,668 [Kaa Node Server Shutdown Thread] ERROR o.k.k.s.c.s.a.AdminInitializationService - Error stopping Kaa Admin web server! 2017-04-19 00:45:39,668 [Kaa Node Server Shutdown Thread]

Failed to connect to zookeeper within 2x zookeeper timeout period 30000

人盡茶涼 提交于 2020-01-16 16:20:41
问题 Failed to connect to zookeeper (10.10.10.205:2181) within 2x zookeeper timeout period 30000 I'm trying to run geomesa client on my local system. I've setup hadoop, accumulo and zookeeper in my virtual machine (whose ip is 10.10.10.205) I can see that my zookeeper is running. 2187 Jps 24929 NameNode 25610 Main 25729 Main 25203 SecondaryNameNode 25055 DataNode 30767 QuorumPeerMain But when I am trying to connect through client. I keep getting this error. java.lang.RuntimeException: Failed to

Zookeeper not logging as per directory path in log4j

自闭症网瘾萝莉.ら 提交于 2020-01-16 14:55:33
问题 I have written a small main class which will instantiate a zookeeper server. public class ZooKeeper { public static void main(String[] args) { QuorumPeerMain qp = new QuorumPeerMain(); QuorumPeerConfig config = new QuorumPeerConfig(); try { config.parse("D:\\kafka_2.12-2.2.0\\config\\zookeeper.properties"); qp.runFromConfig(config); System.out.println("Started...."); } catch (Exception e) { e.printStackTrace(); } } } I give a parameter in -Dlog4j.debug -Dlog4j.configuration=file:D:\zookeeper

Zookeeper not logging as per directory path in log4j

筅森魡賤 提交于 2020-01-16 14:55:03
问题 I have written a small main class which will instantiate a zookeeper server. public class ZooKeeper { public static void main(String[] args) { QuorumPeerMain qp = new QuorumPeerMain(); QuorumPeerConfig config = new QuorumPeerConfig(); try { config.parse("D:\\kafka_2.12-2.2.0\\config\\zookeeper.properties"); qp.runFromConfig(config); System.out.println("Started...."); } catch (Exception e) { e.printStackTrace(); } } } I give a parameter in -Dlog4j.debug -Dlog4j.configuration=file:D:\zookeeper