Jun Thank you for the feedback. I have removed the configuration changes where we are relying on num cores. The only change I have kept is increasing recovery threads to 2 (from 1 as default).
James Thank you for bringing the JIRA to my attention. I haven't looked deeply into the implementation but based on my understanding of the Kafka code base, I do believe that there is a path to implement this constraint. We will cross that bridge during the implementation phase and I will ensure that I look at the historical context you provided in the JIRA. -- Divij Vaidya On Sat, Nov 23, 2024 at 6:48 AM James Cheng <wushuja...@gmail.com> wrote: > About replication.factor >= min.insync.replicas change, you should look at > https://issues.apache.org/jira/browse/KAFKA-4680 . That JIRA talks about > some of the complexities of detecting it. For example, what if a topic has > replication factor 1, but someone changes the broker-level > min.insync.replicas value to 2? How would that be detected? > > That JIRA has an associated PR. The PR has some comments that link to > discussions on this mailing list. > > That PR, btw, was just closed due to being stale. > > -James > > Sent from my iPhone > > > On Nov 18, 2024, at 2:15 AM, Divij Vaidya <divijvaidy...@gmail.com> > wrote: > > > > Hey folks > > > > With 4.0, we have an opportunity to reset the default values and add > > constraints in the configurations based on our learnings since 3.0. > > > > Here's a KIP which modifies defaults for some properties and modifies the > > constraints for a few others. > > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1030%3A+Change+constraints+and+default+values+for+various+configurations > > > > > > Looking forward for your feedback. > > > > (Previous discussion thread on this topic - > > https://lists.apache.org/thread/3dx9mdmsqf8pko9xdmhks80k96g650zp ) >