I think we figured this out. It looks like the consumption of partitions is
wildly unpredictable. We see a single partition being consumed almost
halfway before switching to another partition for consumption. This causes
us to read messages from a range of dates out of order.
Interesting at least.
It may be hard to reason about ordering across 1400 partitions. Could you
use the SimpleConsumerShell to consume messages from 1 partition and see if
messages are ordered?
Thanks,
Jun
On Fri, Mar 21, 2014 at 1:04 AM, Tom Amon wrote:
> Hi All,
>
> I have a question regarding ordering of consum
Hi All,
I have a question regarding ordering of consumed messages. We timestamp our
messages and send them into Kafka in order. I wrote a simple consumer that
simply consumes the messages and prints out the timestamp. I see messages
for all seven days worth of date being consumed at once.
Our set
