Hi All Please find the below KIP which describes a proposed solution to a couple of issues that have been observed with the replication protocol.
In short, the proposal replaces the use of the High Watermark, for follower log trunctation, with an alternate Generation Marker. This uniquely defines which leader messages were acknowledged by. https://cwiki.apache.org/confluence/display/KAFKA/KIP-101+-+Alter+Replication+Protocol+to+use+Leader+Generation+rather+than+High+Watermark+for+Truncation <https://cwiki.apache.org/confluence/display/KAFKA/KIP-101+-+Alter+Replication+Protocol+to+use+Leader+Generation+rather+than+High+Watermark+for+Truncation> All comments and suggestions greatly appreciated. Ben Stopford Confluent, http://www.confluent.io <http://www.confluent.io/>
