Re: [Kafka-users] Producer not distributing across all partitions

2014-10-22 Thread Mongeol Heo
Hi, First of all, thank you for replaying. And I am using 0.8.1.1. I am expecting the new producer will solve this kind of problem. Thanks, Mungeol On Wed, Oct 22, 2014 at 9:51 AM, Jun Rao wrote: > Yes, what you did is correct. See details in > > https://cwiki.apache.org/confluence/display/KA

Re: [Kafka-users] Producer not distributing across all partitions

2014-10-21 Thread Jun Rao
Yes, what you did is correct. See details in https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whyisdatanotevenlydistributedamongpartitionswhenapartitioningkeyisnotspecified ? It seems that it doesn't work all the time. What version of Kafka are you using? Thanks, Jun On Mon, Oct 20, 20

Re: [Kafka-users] Producer not distributing across all partitions

2014-10-16 Thread Neha Narkhede
A topic.metadata.refresh.interval.ms of 10 mins means that the producer will take 10 mins to detect new partitions. So newly added or reassigned partitions might not get data for 10 mins. In general, if you're still at prototyping stages, I'd recommend using the new producer available on kafka trun