How to use Flink's KafkaSource in Scala?

Question

I\'m trying to run a simple test program with Flink\'s KafkaSource. I\'m using the following:

• Flink 0.9
• Scala 2.10.4
• Kafka 0.8.2.1

Answer 1

The problem seems to be that SBT and Maven profiles do not play well together.

The Flink POMs refer to the Scala version (2.10, 2.11, ...) as a variable, some defined in build profiles. The profiles are not evaluated properly from SBT, so the packaging does not work correctly.

There is an issue and pending pull request to fix this: https://issues.apache.org/jira/browse/FLINK-2408