Re: Kafka Test Error

I created a new project, and only add kaka-client, Flink-kafka-connect and Flink streaming libs, it works. Thanks. > On Apr 2, 2016, at 12:54 AM, Stephan Ewen wrote: > > The issue may be that you include Kafka twice: > > 1) You explicitly add "org.apache.kafka:kafka-clients:0.9.0.0" > 2) You

Re: Kafka Test Error

The issue may be that you include Kafka twice: 1) You explicitly add "org.apache.kafka:kafka-clients:*0.9.0.0*" 2) You add "org.apache.flink:flink-connector-kafka-0.9_2.10:1.0.0", which internally adds "org.apache.kafka:kafka-clients:*0.9.0.1*" These two Kafka versions may conflict. I would drop

Re: Kafka Test Error

Yeah, I mean I read the demo with FlinkKafkaConsumer08(http://data-artisans.com/kafka-flink-a-practical-how-to/ ) then I wrote the program based on Kafka 0.9.0.0 and Flink 1.0.0. > On Apr 1, 2016, at 7:27 PM, Balaji Rajagopalan > wrote

Re: Kafka Test Error

Did you make sure the flinkconnector version and flink version is the same ? Also for 0.8.0.0 you will have to use FlinkKafkaConsumer08 On Fri, Apr 1, 2016 at 3:21 PM, Zhun Shen wrote: > I follow the example of kafka 0.8.0.0 on Flink doc. > > public static void main(String[] args) throws Exc

Re: Kafka Test Error

I follow the example of kafka 0.8.0.0 on Flink doc. public static void main(String[] args) throws Exception { StreamExecutionEnvironment env = StreamExecutionEnvironment.getExecutionEnvironment(); Properties properties = new Properties(); properties.setProperty("bootst

Re: Kafka Test Error

I am using flink 1.0.0 with kafka 0.9 . I works fine for me. I use following dependency. org.apache.flink flink-connector-kafka-0.9_2.10 1.0.0 provided Thanks Ashutosh On Fri, Apr 1, 2016 at 10:46 AM, Zhun Shen wrote: > Hi there, > > I check

Re: Kafka Test Error

Hi there, I check my build.gradle file, I use 'org.apache.flink:flink-connector-kafka-0.9_2.10:1.0.0’, but I found that this lib is based on kaka-clients 0.9.0.1. I want to use Flink streaming to consume Kafka’s events in realtime, but I’m confused by Flink’s libs with different versions. Whic

Re: Kafka Test Error

Hi! A "NoSuchMethodError" usually means that you compile and run against different versions. Make sure the version you reference in the IDE and the version on the cluster are the same. Greetings, Stephan On Wed, Mar 30, 2016 at 9:42 AM, Balaji Rajagopalan < balaji.rajagopa...@olacabs.com> wro

Re: Kafka Test Error

I have tested kafka 0.8.0.2 with flink 1.0.0 and it works for me. Can't talk about kafka 0.9.0.1. On Wed, Mar 30, 2016 at 12:51 PM, Zhun Shen wrote: > Hi there, > > flink version: 1.0.0 > kafka version: 0.9.0.0 > env: local > > I run the script below: > ./bin/flink run -c com.test.flink.FlinkTes

Kafka Test Error

Hi there, flink version: 1.0.0 kafka version: 0.9.0.0 env: local I run the script below: ./bin/flink run -c com.test.flink.FlinkTest test.jar --topic nginx-logs --bootstrap.servers localhost:9092 --zookeeper.connect localhost:2181 --group.id myGroup --partition.assignment.strategy round robin