Re: Kafka version dependency in Spark 1.2

2014-11-10 Thread Helena
Version 0.8.2-beta is published. I'd consider waiting on this, it has quite a few nice changes coming. https://archive.apache.org/dist/kafka/0.8.2-beta/RELEASE_NOTES.html I started the 0.8.1.1 upgrade in a branch a few weeks ago but abandoned it because I wasn't sure if there was interest beyond m

Re: Kafka version dependency in Spark 1.2

2014-11-10 Thread Sean McNamara
to bump the Kafka version dependency in Spark 1.2 from 0.8.0 to 0.8.1.1? Current dependency is still on Kafka 0.8.0 https://github.com/apache/spark/blob/branch-1.2/external/kafka/pom.xml Thanks Bhaskie

Re: Kafka version dependency in Spark 1.2

2014-11-10 Thread Matei Zaharia
Just curious, what are the pros and cons of this? Can the 0.8.1.1 client still talk to 0.8.0 versions of Kafka, or do you need it to match your Kafka version exactly? Matei > On Nov 10, 2014, at 9:48 AM, Bhaskar Dutta wrote: > > Hi, > > Is there any plan to bump the Kafka ver

Kafka version dependency in Spark 1.2

2014-11-10 Thread Bhaskar Dutta
Hi, Is there any plan to bump the Kafka version dependency in Spark 1.2 from 0.8.0 to 0.8.1.1? Current dependency is still on Kafka 0.8.0 https://github.com/apache/spark/blob/branch-1.2/external/kafka/pom.xml Thanks Bhaskie