Re: spark streaming kafka compatibility

2015-07-09 Thread Cody Koeninger
Yes, it should work, let us know if not. On Thu, Jul 9, 2015 at 11:34 AM, Shushant Arora wrote: > Thanks cody, so is it means if old kafka consumer 0.8.1.1 works with > kafka cluster version 0.8.2 then spark streaming 1.3 should also work? > > I have tested standalone consumer kafka consumer 0

Re: spark streaming kafka compatibility

2015-07-09 Thread Shushant Arora
Thanks cody, so is it means if old kafka consumer 0.8.1.1 works with kafka cluster version 0.8.2 then spark streaming 1.3 should also work? I have tested standalone consumer kafka consumer 0.8.0 with kafka cluster 0.8.2 and that works. On Thu, Jul 9, 2015 at 9:58 PM, Cody Koeninger wrote: > I

Re: spark streaming kafka compatibility

2015-07-09 Thread Cody Koeninger
It's the consumer version. Should work with 0.8.2 clusters. On Thu, Jul 9, 2015 at 11:10 AM, Shushant Arora wrote: > Does spark streaming 1.3 requires kafka version 0.8.1.1 and is not > compatible with kafka 0.8.2 ? > > As per maven dependency of spark streaming 1.3 with kafka > > > org.apache.

spark streaming kafka compatibility

2015-07-09 Thread Shushant Arora
Does spark streaming 1.3 requires kafka version 0.8.1.1 and is not compatible with kafka 0.8.2 ? As per maven dependency of spark streaming 1.3 with kafka org.apache.sparkspark-streaming_2.10 1.3.0 providedspark-core_2.10org.apache.spark org.apache.kafkakafka_2.10 0.8.1.1 compilejmxricom.sun.jmxj