Re: Highwater mark interpretation

2020-06-21 Thread D C
The short answer is : yes, a consumer can only consume messages up to the High Watermark. The long answer is not exactly, for the following reasons: At the partition level you have 3 major offsets that are important to the health of the partition and accessibility from the consumer pov: LeO (log

Re: Highwater mark interpretation

2020-06-21 Thread D C
Hey Nag Y, I’m not exactly sure if reducing the replication factor while a broker is down would release the messages to be consumed (or at least not on all partitions) for the simple fact that it might just remove the last replica in the list which might not mach your unreachable broker. Personall

Re: Highwater mark interpretation

2020-06-20 Thread Nag Y
Thanks D C. Thanks a lot . That is quite a detailed explanation. If I understand correctly, ( ignoring the case where producers create transactions) - since the replica is down and never comes , the high watermark CANNOT advance and the consumer CAN NOT read the messages which were sent after the r