Re: Partition size skew using default partitioner (without key)

2016-07-04 Thread Asaf Mesika
Apparently it's documented in the FAQ - but I ignored it since it said "0.8.0" and I was using 0.8.2.1. After reading all the lengthy forum post dating to 2013: The problematic code there is in DefaultEventHandler.scala, but if I'm only using KafkaProducer.java - the java flavor - I won't be expose

Re: Partition size skew using default partitioner (without key)

2016-07-04 Thread Asaf Mesika
Since the image is now shown, here's a direct link to it: https://s32.postimg.org/xoet3vu2t/image.png On Tue, Jul 5, 2016 at 7:01 AM Asaf Mesika wrote: > As we continue to track down the cause I'm trying to ping back here in > case someone new might have an answer to the question below? > > > On

Re: Partition size skew using default partitioner (without key)

2016-07-04 Thread Asaf Mesika
As we continue to track down the cause I'm trying to ping back here in case someone new might have an answer to the question below? On Thu, Jun 16, 2016 at 12:39 PM Asaf Mesika wrote: > Hi, > > We've noticed that we have some partitions receiving more messages than > others. What I've done to le

Partition size skew using default partitioner (without key)

2016-06-16 Thread Asaf Mesika
Hi, We've noticed that we have some partitions receiving more messages than others. What I've done to learn that is: * In Kafka Manager, per a given topic, the list of Partition Information is displayed. * For each partition there's a column called Latest Offset - which I assume is the producer of