[jira] [Created] (KAFKA-19622) Limitations of KRAFT Dual Write Mode for Production Support

2025-08-19 Thread Sharad Garg (Jira)
Sharad Garg created KAFKA-19622: --- Summary: Limitations of KRAFT Dual Write Mode for Production Support Key: KAFKA-19622 URL: https://issues.apache.org/jira/browse/KAFKA-19622 Project: Kafka Is

[jira] [Created] (KAFKA-19621) Implement cleanup mechanism for obsolete Remote Log Metadata

2025-08-19 Thread Lan Ding (Jira)
Lan Ding created KAFKA-19621: Summary: Implement cleanup mechanism for obsolete Remote Log Metadata Key: KAFKA-19621 URL: https://issues.apache.org/jira/browse/KAFKA-19621 Project: Kafka Issue T

[DISCUSS] KIP-1207: Fix anomaly of JMX metrics RequestHandlerAvgIdlePercent in kraft combined mode

2025-08-19 Thread Tony Tang
Hello everyone, I'd like to discuss a KIP regarding adding new metrics for request handler pool and fixing the anomaly of a JMX metric. KIP link Thanks, To

Re: [VOTE] KIP-1190: Add a metric for controller thread idleness

2025-08-19 Thread José Armando García Sancio
Thanks for the KIP. +1 binding. On Thu, Aug 7, 2025 at 12:54 PM David Arthur wrote: > > Thanks for the KIP, Mahsa! > > Seems like a useful metric to add on the controller. > > +1 binding > > -David > > On Tue, Aug 5, 2025 at 1:58 PM Manikumar wrote: > > > Hi, > > > > Thanks for the KIP. > > > >

Re: [VOTE] KIP-1147: Improve consistency of command-line arguments

2025-08-19 Thread Kuan-Po Tseng
+1 (non-binding) Thanks for improving the CLI tool! Best regards, Kuan-Po Tseng On Wed, Aug 20, 2025 at 1:23 AM Lianet M. wrote: > Thanks for the updates Andrew from the discussion thread, lgtm. Looking > forward to using this! > > +1 (binding) > > Lianet > > On Wed, Aug 13, 2025 at 10:31 AM A

[jira] [Created] (KAFKA-19620) Move AutoTopicCreationManager to server module

2025-08-19 Thread Kuan Po Tseng (Jira)
Kuan Po Tseng created KAFKA-19620: - Summary: Move AutoTopicCreationManager to server module Key: KAFKA-19620 URL: https://issues.apache.org/jira/browse/KAFKA-19620 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-1159: Large message reference based Serializer

2025-08-19 Thread Greg Harris
Hi Omnia, Thanks for your replies. 1. > There are other concerns like amplifying all Kafka resources like network bandwidth, memory pressure, and I/O operations becoming more unpredictable. Thanks for pointing this out, I agree that KIP-1163 does not address these multi-tenant concerns. I brough

Re: [VOTE] KIP-1147: Improve consistency of command-line arguments

2025-08-19 Thread Lianet M.
Thanks for the updates Andrew from the discussion thread, lgtm. Looking forward to using this! +1 (binding) Lianet On Wed, Aug 13, 2025 at 10:31 AM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi Lianet, > Thanks for the comments. > > LM1: I am horrified to be told that I had

Re: [VOTE] 4.1.0 RC2

2025-08-19 Thread Apoorv Mittal
Thanks Mickael. I ran the following: 1. Verified the signature and checksum for kafka_2.13-4.1.0.tgz and kafka-4.1.0-src.tgz. 2. Ran the quickstart. 3. Ran the kafka-console-share-consumer.sh without feature flag toggle to confirm share groups feature is not supported, and appropriate error messag

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-08-19 Thread Jun Rao
Hi, Andrew, Thanks for the updated KIP. It looks good to me. Jun On Tue, Aug 19, 2025 at 3:24 AM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote: > Hi Tommi, > Thank you for catching that. Fixed also. > > Andrew > > From: Tommi Vainikainen >

Re: [DISCUSS] KIP-1190: Add a metric for controller thread idleness

2025-08-19 Thread Mahsa Seifikar
"But value is the average ratio over the polling interval" If we look at it in that way, using the average makes sense to me. I've updated the KIP. Thanks Joe for the clarification. Mahsa Seifikar On Tue, Aug 19, 2025 at 10:26 AM José Armando García Sancio wrote: > Thanks for the update Mahsa.

Re: [VOTE] 4.1.0 RC2

2025-08-19 Thread Kuan-Po Tseng
Hi Mickael, I did the following: - Built from 4.1.0-rc2 with 23.0.2-zulu - Ran all unit and integration tests - Validated the checksums and keys - Run quick start with KRaft - Run kafka streams demo application All of the above tests completed successfully. +1 (non-binding) Thank you! Kuan-Po T

Re: [DISCUSS] KIP-1159: Large message reference based Serializer

2025-08-19 Thread Omnia Ibrahim
Hi Greg, Thanks for reviewing the KIP! > > Could you discuss the rejected alternative of improving Kafka's handling of > > large messages in-band? If Kafka is better at handling large messages, then > > it may not be necessary to adopt the complexity of reference-based > > messaging. > > I wonder

[VOTE] 4.0.1 RC1

2025-08-19 Thread Christo Lolov
Hello Kafka users, developers and client-developers, This is the second candidate for release of Apache Kafka 4.0.1. Since this is a patch version it contains the bug fixes outlined in the release notes below! Release notes for the 4.0.1 release: https://dist.apache.org/repos/dist/dev/kafka/4.0.

[DISCUSS] KIP-1205: Improve RecordHeader to be Thread-Safe

2025-08-19 Thread Ming-Yen Chung
Hi all, I would like to start a discussions on KIP-1205: Improve RecordHeader to be Thread-Safe: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1205%3A+Improve+RecordHeader+to+be+Thread-Safe This proposal uses double-checked locking and volatile to make RecordHeader thread-safe. Best, M

Re: [DISCUSS] KIP-1190: Add a metric for controller thread idleness

2025-08-19 Thread José Armando García Sancio
Thanks for the update Mahsa. On Mon, Aug 18, 2025 at 12:59 PM Mahsa Seifikar wrote: > > "How about just calling it AvgIdleRatio?" > I think it's better to avoid using "Avg" because the metric is not a true > average, which could be misleading. We have a similar confusion with > "poll-idle-ratio-a

[jira] [Created] (KAFKA-19619) Refactore DescribeTopicPartitionsRequestHandler: Improve readability and add code documentation

2025-08-19 Thread Adeshina Lasisi (Jira)
Adeshina Lasisi created KAFKA-19619: --- Summary: Refactore DescribeTopicPartitionsRequestHandler: Improve readability and add code documentation Key: KAFKA-19619 URL: https://issues.apache.org/jira/browse/KAFKA-19

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-08-19 Thread Andrew Schofield
Hi Tommi, Thank you for catching that. Fixed also. Andrew From: Tommi Vainikainen Sent: 19 August 2025 09:02 To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments Hi, Now the first bullet in Public Inter

RE: [DISCUSS] KIP-780: Support fine-grained compression options

2025-08-19 Thread Maroš Orsák
Hi all, FYI: I’ve updated the JIRA [1] with the latest changes and added benchmarks covering all possible configurations, along with a summary of when to use each codec. I’ve also opened a PR [2] to provide a clearer picture of the specific changes. Let me know what you think, Maros [1] - https

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-08-19 Thread Tommi Vainikainen
Hi, Now the first bullet in Public Interfaces is not in sync with recent changes as it still refers to --producer-property in the sentence about order of precedence. That should be now --command-property. On Tue, Aug 19, 2025 at 10:48 AM Andrew Schofield < andrew_schofield_j...@outlook.com> wrote

Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments

2025-08-19 Thread Andrew Schofield
Hi Jun and Lianet, Thanks for the comment. It's a good point. I've updated the KIP. Thanks, Andrew From: Jun Rao Sent: 18 August 2025 17:41 To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-1147: Improve consistency of command-line arguments Hi, Andre