Re: Spark that integrates with Kafka 0.7

2014-09-05 Thread Hemanth Yamijala
After that long mail :-), I think I figured it out. I removed the 'provided' tag in my pom.xml and let the jars be directly included using maven's jar-with-dependencies plugin. Things started working after that. Thanks Hemanth On Fri, Sep 5, 2014 at 9:50 PM, Hemanth Yamijala wrote: > After sea

Re: Spark that integrates with Kafka 0.7

2014-09-05 Thread Hemanth Yamijala
After searching a little bit, I came to know that Spark 0.8 supports kafka-0.7. So, I tried to use it this way: In my pom.xml, specified a Spark dependency as follows: org.apache.spark spark-streaming_2.9.3 0.8.1-incubating And a kafka dependency as follows:

Spark that integrates with Kafka 0.7

2014-09-05 Thread Hemanth Yamijala
Hi, Due to some limitations, we are having to stick to Kafka 0.7.x. We would like to use as latest a version of Spark in streaming mode that integrates with Kafka 0.7. The latest version supports only 0.8 it appears. Has anyone solved such a requirement ? Any tips on what can be tried ? FWIW, I t