Re: New producer in production

2015-08-09 Thread yuto sasaki
Hi, Is there any progress on this doc bug? This discourages us from using the new producer. Thanks On 2015/07/18 5:23, Sivananda Reddy wrote: Hi Jay, I found it here: http://kafka.apache.org/documentation.html#newproducerconfigs, the same link is reported by James. @Joel: Thanks a lot for t

Re: New producer in production

2015-07-20 Thread Sivananda Reddy
Hi James, Thanks for the info. For my use case I have a custom partition key assignment to the producers. Regards, Siva. On Fri, Jul 17, 2015 at 1:36 PM, James Cheng wrote: > Be aware that the old producer and new producer have different > partitioning algorithms: > > http://mail-archives.apac

Re: New producer in production

2015-07-17 Thread James Cheng
Be aware that the old producer and new producer have different partitioning algorithms: http://mail-archives.apache.org/mod_mbox/kafka-users/201504.mbox/%3C4A6E5F2C-232E-4288-8F9F-3F9D9AE05718%40tivo.com%3E This could bite you if you rely on key-based partitioning and are switching from the old

Re: New producer in production

2015-07-17 Thread Sivananda Reddy
Hi Jay, I found it here: http://kafka.apache.org/documentation.html#newproducerconfigs, the same link is reported by James. @Joel: Thanks a lot for the info, I will use new producer Regards, Siva. On Fri, Jul 17, 2015 at 12:02 PM, James Cheng wrote: > http://kafka.apache.org/documentation.htm

Re: New producer in production

2015-07-17 Thread James Cheng
http://kafka.apache.org/documentation.html, Section 3.4. > 3.4 New Producer Configs > > We are working on a replacement for our existing producer. The code is > available in trunk now and can be considered beta quality. Below is the > configuration for the new producer. Sivananda might have se

Re: New producer in production

2015-07-17 Thread Joel Koshy
It is pretty safe :) and adopting it now will save you the trouble of migrating later. At LinkedIn, we are using the new producer for all the producers that the Kafka team directly own - this means mirror-maker pipelines, REST proxies and some auditing tools. We have not yet migrated other produce

Re: New producer in production

2015-07-17 Thread Jay Kreps
Hey Sivananda, That's actually no longer true and likely a documentation bug. Where did you see that? -Jay On Fri, Jul 17, 2015 at 9:35 AM, Sivananda Reddy wrote: > Hi, > > Kafka document ion says that the new producer is in Beta state, how safe is > it to use the new producer in production?.