How to connect Kafka with Elasticsearch?

Question

I am new in Kafka, I use kafka to collect netflow through logstash(it is ok), and I want to send the data to elasticsearch from kafka, but there are some problems.
My questi

Answer 1

The empty input block for Kafka will not work, since it doesn't know where to get the data from. The minimal config for your scenario will be something like this:

input {
    kafka {
            bootstrap_servers => "localhost:9092"
            topics => "test"
    }
}

Answer 2

I would suggest using Kafka Connect and its Elasticsearch sink. I actually presented on exactly this subject last night :) Here are the slides.

You can see a detailed example here.

Update May 2020: See also this tutorial video.