KRaft Migration and Kafka Controller behaviour

2024-03-18 Thread Sanaa Syed
Hello, I've begun migrating some of my Zookeeper Kafka clusters to KRaft. A behaviour I've noticed twice across two different kafka cluster environments is after provisioning a kraft controller quorum in migration mode, it is possible for a kafka broker to become an active controller alongside a k

Re: KRaft Migration and Kafka Controller behaviour

2024-03-19 Thread Sanaa Syed
elete the /controller znode (as > the procedure describe). Only in this case a broker is able to "win" the > /controller by using -1 as epoch (because the /controller znode doesn't > exist anymore). > Not sure if in your case you made some mistakes during the migration or >

KRaft reconciling old default configs as dynamic configs

2024-04-12 Thread Sanaa Syed
Hi there, I recently ran into an issue where I noticed that we had many old broker and configs set in zookeeper that were migrated over in KRaft mode. For example, this was a cluster default from 2020 that was moved over: get /config/brokers/ {"version":1,"config":{"num.network.threads":"6","num