Hi everyone, Following up on this thread, I've opened a draft KIP for everyone to contribute to: https://cwiki.apache.org/confluence/display/KAFKA/KIP-986%3A+Cross-Cluster+Replication https://lists.apache.org/thread/4563fqdcwlqwjqlm7mbj8wftx1rpo0yd
Please consider yourselves owners of this feature, and make edits to the KIP directly when you feel it is appropriate. Thanks! Greg Harris On Mon, May 22, 2023 at 4:59 AM Andrew Otto <o...@wikimedia.org> wrote: > > Hello! > > The Wikimedia Foundation would be very interested in this feature. It > would make deployment of multi DC/region streaming apps much simpler. We'd > like to investigate more the feasibility of using a Kafka stretch cluster > <https://lists.apache.org/thread/r4wrk7xg0hymodr5k91d0xkbx0ms2w0x>to solve > this problem, but something built into Kafka itself that still allows for > distinct Kafka clusters would be really great! > > -Andrew Otto > > On Sat, May 20, 2023 at 7:42 AM hudeqi <16120...@bjtu.edu.cn> wrote: > > > Hi, I am also very excited to see this discussion, because I also > > implemented the "federation model" based on the kafka-0.10.2.1 version > > before in company and got benefits from going online. It solves the problem > > of seamlessly migrating the bytesIn/bytesOut of a topic to another kafka > > cluster without the client being aware. Therefore, it includes the > > cross-cluster synchronous topic data mentioned in this discussion, and > > ensures the consistency of the offset. It also provides the global > > coordinator service to ensure the consistency of the group offset, and the > > metadata service to ensure that the client is visible of the real traffic > > cluster of the topic. So I am very excited to see that the community has > > finally discussed this feature, and I especially hope to participate in the > > development and reviewer of this feature as a co-author. > > > > > > > -----原始邮件----- > > > 发件人: "Chia-Ping Tsai" <chia7...@gmail.com> > > > 发送时间: 2023-05-20 18:57:31 (星期六) > > > 收件人: dev@kafka.apache.org > > > 抄送: t...@conduktor.io.invalid > > > 主题: Re: [DISCUSS] Cluster Linking / Cross-Cluster Replication - Call > > for Interest & Co-Authors > > > > > </chia7...@gmail.com>
