Re: Flink Kafka 0.10.0.0 connector

2016-11-03 Thread Dominik Safaric
Hi Robert, Thanks for sharing this insight. However, the Flink Kafka 010 connector is only compatible with the 1.2-SNAPSHOT. Despite that, I’ve managed to get the Flink Kafka 09 use the Kafka version 0.10.0.1 Only minor changes to the test code had to be made, mostly in regard to Zookeeper

Re: Flink Kafka 0.10.0.0 connector

2016-11-03 Thread Robert Metzger
Hi, I just tried the Kafka 0.10 connector again, and I could not reproduce the issue you are reporting. This is my test job: // parse input arguments final ParameterTool parameterTool = ParameterTool.fromArgs(args); if(parameterTool.getNumberOfParameters() < 4) { System.out.println("Missing p

Re: Flink Kafka 0.10.0.0 connector

2016-11-03 Thread Dominik Safaric
Hi Robert, > I think the easiest way to get Kafka 0.10 running with Flink is to use the > Kafka 0.10 connector in the current Flink master. Well, I’ve already builded the Kafka 0.10 connector from the master, but unfortunately I keep getting the error of the type checker that the type of the

Re: Flink Kafka 0.10.0.0 connector

2016-11-03 Thread Robert Metzger
Hi Dominik, Some of Kafka's APIs changed between Kafka 0.9 and 0.10, so you can not compile the Kafka 0.9 against Kafka 0.10 dependencies. I think the easiest way to get Kafka 0.10 running with Flink is to use the Kafka 0.10 connector in the current Flink master. You can probably copy the connect

Flink Kafka 0.10.0.0 connector

2016-11-03 Thread Dominik Safaric
Dear all, Although the Flink 1.2 version will rollout a Flink Kafka 0.10.x connector, I want to use the Flink 0.9 connector in conjunction with the 0.10.x versions. The reason behind this is because we are currently evaluating Flink part of an empirical research, hence a stable release is requ