Re: New Kafka producer API

2015-05-05 Thread BenFradet
Yes that might be true, I will have to test that. -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/New-Kafka-producer-API-tp12050p12058.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

Re: New Kafka producer API

2015-05-05 Thread Cody Koeninger
Regarding performance, keep in mind we'd probably have to turn all those async calls into blocking calls for the unit tests On Tue, May 5, 2015 at 3:44 PM, BenFradet wrote: > Even if it's only used for testing and the examples, why not move ahead of > the deprecation and gain some performance al

Re: New Kafka producer API

2015-05-05 Thread BenFradet
Even if it's only used for testing and the examples, why not move ahead of the deprecation and gain some performance along the way. Plus, regarding the examples, I think it's good practice to use the recommended API and not the legacy one. -- View this message in context: http://apache-spark-d

Re: New Kafka producer API

2015-05-05 Thread Cody Koeninger
Since that's an internal class used only for unit testing, what would the benefit be? On Tue, May 5, 2015 at 3:19 PM, BenFradet wrote: > Hi, > > Since we're now supporting Kafka 0.8.2.1 > , and that there is a new > Producer API