Re: [DISCUSS] KIP-878: Autoscaling for Statically Partitioned Streams

Thanks all! I'll try to address everything but don't hesitate to call me out if anything is missed Colt/Lucas: Thanks for clarifying, I think I understand your example now. Something I didn't think to mention earlier but hopefully clears up how this would be used in practice is that the partition

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1322

See

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

Hi, David, Thanks for the reply. 20/21. Relying upon the presence of ZK configs to determine whether the KRaft controller is in a dual write mode seems a bit error prone. If someone accidentally adds a ZK configuration to a brand new KRaft cluster, ideally it shouldn't cause the controller to get

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

Jun, 20/21. A KRaft controller will recover the migration state by reading the "/migration" ZNode. If the migration enable config is set, and the ZK migration is complete, it will enter the dual-write mode. Before an operator can decommission ZK, they will need to finalize the migration which invo

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.3 #111

See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1321

See

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

Hi, David, Thanks for the reply. A few more comments. 20/21. Using a tagged field in ApiVersionRequest could work. Related to this, how does a KRaft controller know that it's in the dual write mode? Does it need to read the /controller path from ZK? After the migration, people may have the ZK clu

Re: [VOTE] KIP-710: Full support for distributed mode in dedicated MirrorMaker 2.0 clusters

+1 (non-binding). Thanks for the KIP! On Mon, Oct 24, 2022 at 3:23 PM Chris Egerton wrote: > +1 (binding). Thanks for the KIP! > > On Sat, Oct 22, 2022 at 3:38 AM Urbán Dániel > wrote: > > > Hi everyone, > > > > I would like to start a vote on KIP-710 which aims to support running a > > dedicat

[jira] [Created] (KAFKA-14339) producer commits-transaction even if offsetWriter faces serializationError

Sudesh Wasnik created KAFKA-14339: - Summary: producer commits-transaction even if offsetWriter faces serializationError Key: KAFKA-14339 URL: https://issues.apache.org/jira/browse/KAFKA-14339 Project:

Re: [DISCUSS] KIP-878: Autoscaling for Statically Partitioned Streams

Hey Sophie, This looks like a very nice feature. Going through the comments, I agree with Bill above that there could be a case for skew on keys given the earlier partitions would have the data which it already had and get some more. Do you think that's a concern/side-effect that this feature coul