broker

Kafka : Update jaas config dynamically

荒凉一梦 提交于 2019-12-10 23:57:01
问题 I have setup the jaas config for kafka using sasl.jaas.config property. I want to update this config and add users dynamically. As per this doc - http://kafka.apache.org/11/documentation.html#dynamicbrokerconfigs, we can do that by using bin/kafka-configs.sh . The above doc has config column, which says as follow - I have tried updating sasl.jaas.config with below command: bin/kafka-configs.sh --bootstrap-server localhost:9092 --entity-type brokers --entity-name 59 --alter --add-config sasl

RabbitMQ 3.1.3 and the missing timestamp header

雨燕双飞 提交于 2019-12-10 17:39:54
问题 Is it possible to configure the broker to insert a timestamp header if it is missing in the message? So if the publishing client does not add the timestamp header, can the broker insert it with a timestamp value matching the moment the message was received by the exchange? Where should I look for that configuration? Or is that a bad idea? 回答1: So to answer your question, no there is no way to configure the broker to insert a timestamp. Nothing the in AMQP specification requires a message to

In RabbitMQ which is more expensive, multiple queues per exchange, or multiple exchanges and less queues per each?

隐身守侯 提交于 2019-12-10 12:35:30
问题 So we decided to go with RabbitMQ as a message/event bus in our migration to micro-services architecture, but we couldn't find a definite answer on what is the best way of putting our queues, we have two options to go with: One main exchange which will be a Fanout exchange, which in turn will fan messages out to a main queue for logging and other purposes and another sub exchange which will be a topic exchange and route the messages to each desired queue using the message routing key. We

ActiveMQ:No operations allowed after statement ...

大兔子大兔子 提交于 2019-12-02 15:53:27
ActiveMQ版本:5.5.1 记录人:@郑昀 现象: 系统现象:部分消息发送失败,失败频率不正常。 日志信息:activemq.log 中一直有这样的错误日志: JDBC Failure : No operations allowed after statement closed . com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after statement closed. at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39) ………… at org.apache.activemq.transport. InactivityMonitor .onCommand(InactivityMonitor.java:227) at org.apache.activemq.transport.TransportSupport.doConsume

Is Zookeeper a must for Kafka?

≯℡__Kan透↙ 提交于 2019-11-30 06:12:55
问题 In Kafka, I would like to use only a single broker, single topic and a single partition having one producer and multiple consumers (each consumer getting its own copy of data from the broker). Given this, I do not want the overhead of using Zookeeper; Can I not just use the broker only? Why is a Zookeeper must? 回答1: Yes, Zookeeper is required for running Kafka. From the Kafka Getting Started documentation: Step 2: Start the server Kafka uses zookeeper so you need to first start a zookeeper

Is Zookeeper a must for Kafka?

和自甴很熟 提交于 2019-11-28 15:51:16
In Kafka, I would like to use only a single broker, single topic and a single partition having one producer and multiple consumers (each consumer getting its own copy of data from the broker). Given this, I do not want the overhead of using Zookeeper; Can I not just use the broker only? Why is a Zookeeper must? John Petrone Yes, Zookeeper is required for running Kafka. From the Kafka Getting Started documentation: Step 2: Start the server Kafka uses zookeeper so you need to first start a zookeeper server if you don't already have one. You can use the convenience script packaged with kafka to