Re: Data is been written in only 1 partition

2014-08-01 Thread François Langelier
Thanks guys! I found my problem :) I'm using the DefaultPartitioner and I was using the topic name as key... I though it was doing a round-robin like in kafka 0.7 and not a hash of the key... Thank you for your help, it's really appreciate!:) François Langelier Étudiant en génie Logiciel - Éc

Re: Data is been written in only 1 partition

2014-08-01 Thread Jun Rao
Have you looked at https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-Whyisdatanotevenlydistributedamongpartitionswhenapartitioningkeyisnotspecified ? Thanks, Jun On Fri, Aug 1, 2014 at 7:33 AM, François Langelier wrote: > HI all! > > I think I already saw this question on the mailing

Re: Data is been written in only 1 partition

2014-08-01 Thread Jim Plush
Are you using the random partitioner or a custom partitioner in your producer? Is your producer picking up all the available partitions? What producer client are you using? On 8/1/14, 7:33 AM, "François Langelier" wrote: >HI all! > >I think I already saw this question on the mailing list, but I'

Data is been written in only 1 partition

2014-08-01 Thread François Langelier
HI all! I think I already saw this question on the mailing list, but I'm not able to find it back... I'm using kafka 0.8.1.1, i have 3 brokers and I have a default replication factor of 2 and a default partitioning factor of 2. My partition are distributed fairly on every brokers. My problem is