Re: Question about upgrading Kafka client version

2017-03-10 Thread Shixiong(Ryan) Zhu
I did some investigation yesterday and just posted my finds in the ticket. Please read my latest comment in https://issues.apache.org/ jira/browse/SPARK-18057 On Fri, Mar 10, 2017 at 11:41 AM, Cody Koeninger wrote: > There are existing tickets on the issues around kafka versions, e.g. > https://

Re: Question about upgrading Kafka client version

2017-03-10 Thread Cody Koeninger
There are existing tickets on the issues around kafka versions, e.g. https://issues.apache.org/jira/browse/SPARK-18057 that haven't gotten any committer weigh-in on direction. On Thu, Mar 9, 2017 at 12:52 PM, Oscar Batori wrote: > Guys, > > To change the subject from meta-voting... > > We are doi

Question about upgrading Kafka client version

2017-03-09 Thread Oscar Batori
Guys, To change the subject from meta-voting... We are doing Spark Streaming against a Kafka setup, everything is pretty standard, and pretty current. In particular we are using Spark 2.1, and Kafka 0.10.1, with batch windows that are quite large (5-10 minutes). The problem we are having is prett