Re: Complete Kafka replication protocol description

2023-09-12 Thread Federico Valeri
Hi Jack, thanks for providing this material. I'll spend some time digging into it. On Mon, Sep 11, 2023 at 6:56 PM Jack Vanlightly wrote: > > Hi all, > > I agree that we should have the protocol description and specification in > the Kafka repository. I have two other specifications to contribute

Re: Complete Kafka replication protocol description

2023-09-11 Thread Jack Vanlightly
Hi all, I agree that we should have the protocol description and specification in the Kafka repository. I have two other specifications to contribute including the KRaft implementation of Raft and the next gen consumer group protocol (WIP). I also have a formal prose description of the Kafka repli

Re: Complete Kafka replication protocol description

2023-09-11 Thread Divij Vaidya
This is very useful Jack! 1. We are missing a replication protocol specification in our project. Ideally it should be a living document and adding what you wrote to the docs/design would be a great start towards that goal. 2. I have also been building on top of some existing TLA+ to add changes to

Re: Complete Kafka replication protocol description

2023-09-10 Thread Haruki Okada
Hi Jack, Thank you for the great work, not only the spec but also for the comprehensive documentation about the replication. Actually I wrote some TLA+ spec to verify unclean leader election behavior before so I will double-check my understanding with your complete spec :) Thanks, 2023年9月10日(日)

Re: Complete Kafka replication protocol description

2023-09-10 Thread David Jacot
Hi Jack, This is great! Thanks for doing it. I will look into it when I have a bit of time, likely after Current. Would you be interested in contributing it to the main repository? That would be a great contribution to the project. Having it there would allow the community to maintain it while ch