logstash Input painfully slow while fetching messages from activemq topic

我的梦境 提交于 2019-12-10 22:59:51

问题


I have configured JMS input in logstash to subscribe to JMS topic messages and push messages to elastic search.

input {

  jms {
      id => "my_first_jms"
      yaml_file => "D:\softwares\logstash-6.4.0\config\jms-amq.yml"
      yaml_section => "dev"
      use_jms_timestamp => true
      pub_sub => true
      destination => "mytopic"
#     threads => 50
    }
}

filter {
    json{
      source => "message"
    }

}

output {
    stdout { codec => json }

    elasticsearch {
      hosts => ['http://localhost:9401']
      index => "jmsindex"
  }
}

System specs:

RAM: 16 GB
Type: 64 bit
Processor: Intel i5-4570T CPU @ 2.9 GHz

This is extremely slow. Like 1 message every 3-4 minutes. How should I debug to figure out what is missing?

Note: Before this, I was doing this with @JMSListener in java and that could process 200-300 records per sec easily.

来源:https://stackoverflow.com/questions/54392216/logstash-input-painfully-slow-while-fetching-messages-from-activemq-topic

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!