spring-kafka

问题 I Want to write one new application with Spring boot using the database as MySQL + Mango and for messaging Spring Kafka. I tried with Many POC for synchronizing the transaction between Kafka and DB but I failed in certain conditions and also I searched many Repositories, blogs to get at least one example. I didn't get any example still now. if anyone gives at least one example or configurations it would be a nice reference in the future for all. 回答1: Here you go... @SpringBootApplication

问题 We have a spring cloud stream app using Kafka. The requirement is that on the producer side the list of messages needs to be put in a topic in a transaction. There is no consumer for the messages in the same app. When i initiated the transaction using spring.cloud.stream.kafka.binder.transaction.transaction-id prefix, I am facing the error that there is no subscriber for the dispatcher and a total number of partitions obtained from the topic is less than the transaction configured. The app is

问题 We have a spring cloud stream app using Kafka. The requirement is that on the producer side the list of messages needs to be put in a topic in a transaction. There is no consumer for the messages in the same app. When i initiated the transaction using spring.cloud.stream.kafka.binder.transaction.transaction-id prefix, I am facing the error that there is no subscriber for the dispatcher and a total number of partitions obtained from the topic is less than the transaction configured. The app is

问题 I am using Springboot 2.3.5.RELEASE along with spring-kafka 2.6.3. I am trying do a simple Kafka Producer Retry POC which should result in a producer retrying when the broker is down or if there is an exception thrown before a message is sent to broker. The below producer config is for Idempotent producer with retries enabled. // Producer configuration @Bean public Map<String, Object> producerConfigs() { Map<String, Object> props = new HashMap<>(); props.put(ProducerConfig.BOOTSTRAP_SERVERS

问题 Suppose I have different values for a same message key. For example: { userid: 1, email: user123@xyz.com } { userid: 1, email: user456@xyz.com } { userid: 1, email: user789@xyz.com } In this above case I want only the latest value updated by the user, that is, 'user789@xyz.com'. My kafka stream should give me only the third value and not the previous 2 values. 回答1: Since you've not specified a particular client, I'll show you how this can be done with ksqlDB and the newly-added function,

问题 Suppose I have different values for a same message key. For example: { userid: 1, email: user123@xyz.com } { userid: 1, email: user456@xyz.com } { userid: 1, email: user789@xyz.com } In this above case I want only the latest value updated by the user, that is, 'user789@xyz.com'. My kafka stream should give me only the third value and not the previous 2 values. 回答1: Since you've not specified a particular client, I'll show you how this can be done with ksqlDB and the newly-added function,

问题 Suppose I have different values for a same message key. For example: { userid: 1, email: user123@xyz.com } { userid: 1, email: user456@xyz.com } { userid: 1, email: user789@xyz.com } In this above case I want only the latest value updated by the user, that is, 'user789@xyz.com'. My kafka stream should give me only the third value and not the previous 2 values. 回答1: Since you've not specified a particular client, I'll show you how this can be done with ksqlDB and the newly-added function,

问题 Suppose I have different values for a same message key. For example: { userid: 1, email: user123@xyz.com } { userid: 1, email: user456@xyz.com } { userid: 1, email: user789@xyz.com } In this above case I want only the latest value updated by the user, that is, 'user789@xyz.com'. My kafka stream should give me only the third value and not the previous 2 values. 回答1: Since you've not specified a particular client, I'll show you how this can be done with ksqlDB and the newly-added function,

问题 How to use Spring-Kafka to read AVRO message with Confluent Schema registry? Is there any sample? I can't find it in official reference document. 回答1: Below code can read the message from customer-avro topic. Here's the AVRO schema on value i have defined as. { "type": "record", "namespace": "com.example", "name": "Customer", "version": "1", "fields": [ { "name": "first_name", "type": "string", "doc": "First Name of Customer" }, { "name": "last_name", "type": "string", "doc": "Last Name of

问题 How to use Spring-Kafka to read AVRO message with Confluent Schema registry? Is there any sample? I can't find it in official reference document. 回答1: Below code can read the message from customer-avro topic. Here's the AVRO schema on value i have defined as. { "type": "record", "namespace": "com.example", "name": "Customer", "version": "1", "fields": [ { "name": "first_name", "type": "string", "doc": "First Name of Customer" }, { "name": "last_name", "type": "string", "doc": "Last Name of