What's the behavior when Kafka is deleting messages and consumers are still reading

When Kafka broker is trying to delete message according to the log retention setting, either triggered by log age or topic partition size, if the same time there are still consumers reading the topic, what will happen? Best regards, Lex Lian Email: ll...@ebay.com

Re: What's the behavior when Kafka is deleting messages and consumers are still reading

restart from a offset reset value. > >Guozhang > > >On Tue, Jun 24, 2014 at 5:20 AM, Lian, Li wrote: > >> When Kafka broker is trying to delete message according to the log >> retention setting, either triggered by log age or topic partition size, >>if >>

how is the partitioner working when compression is enabled?

I am using Kafka 0.8 and message compression can only be enabled on producer side. However one batch of messages (decided by the producer configuration batch.num.messages) is compressed as a single message and stored at the broker side. I think one batch compressed message will be stored at one