Re: log is not getting segmented for 1 partition only

2019-05-21 Thread Rajat Gangwar
Hi Vincent, As log.roll is every 7 days and retention is 30 days, what you suspect will only happen if that partition received the first message after 23 days. Which is highly unlikely, given there is no partition logic, messages should be uniformly distributed. When I said inflow is not high, I m

Re: log is not getting segmented for 1 partition only

2019-05-21 Thread Vincent Maurin
Hi Rajat I am not 100% sure, but I think the roll logic is based on incoming messages. When a message is received, it will compare the timestamp of the first message in the log vs the timestamp of the incoming message. If it is greater than log.roll.ms, it will roll the segment In your scenario,