how to pause and resume @KafkaListener using spring-kafka

北城余情 提交于 2020-06-23 11:45:46

问题


I have implemented the Kafka consumer, now I have a scenario.

  1. Read data from the Kafka stream 2.2.5.Release via Srpingboot
  2. load in the database table1
  3. copy the data from table1 to table2
  4. clear the table1

To do the above things, I need to pause/resume the Kafka consumer using a scheduling job(already written) using quartz, which copies data from table 1 to table 2. But during this activity, I want my Kafka listener to pause, and once the copy is done, it should resume.

My implementation:

@KafkaListener(topicPartitions =
    { @TopicPartition(topic = "data_pipe", partitions = { "0" })})
public void listen(ConsumerRecord<String, String> cr) throws Exception {

回答1:


if you use 'kafkaListener annotation' auto created KafkaListenerEndpointRegistry bean, so, You can use it like this code:

@Component
public class KafkaManager {

    private final KafkaListenerEndpointRegistry registry;

    public KafkaManager(KafkaListenerEndpointRegistry registry) {
        this.registry = registry;
    }
    public void pause() {
        registry.getListenerContainers().forEach(MessageListenerContainer::pause);
    }

    public void resume() {
        registry.getListenerContainers().forEach(MessageListenerContainer::resume);
    }
}

document : https://docs.spring.io/spring-kafka/reference/html/#pause-resume



来源:https://stackoverflow.com/questions/58336973/how-to-pause-and-resume-kafkalistener-using-spring-kafka

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!