Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

Hi everyone, I have revised this KIP multiple times based on the feedback from our discussions. I would greatly appreciate it if you could review it when you have the time. If there are no further comments or suggestions, I plan to proceed with initiating a vote soon. Best regards, TengYao TengY

[VOTE] KIP-1079: Deprecate `delete-config` of TopicCommand

Hi everyone, The discussion of KIP-1079 has been silent for a long time, I believe this KIP is now ready for a vote. Since

[jira] [Created] (KAFKA-17428) remote segments deleted in RLMCopyTask stays `COPY_SEGMENT_START` state

Luke Chen created KAFKA-17428: - Summary: remote segments deleted in RLMCopyTask stays `COPY_SEGMENT_START` state Key: KAFKA-17428 URL: https://issues.apache.org/jira/browse/KAFKA-17428 Project: Kafka

Re: [DISCUSS] KIP-1075: Introduce delayed remote list offsets purgatory to make LIST_OFFSETS async

Hi all, This KIP needs one more binding vote to pass. Please review the KIP. Thanks! -- Kamal On Sat, Aug 24, 2024 at 8:11 AM Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > Hi Jun, > > Thanks for the review! > > 1. purgatoryName = RemoteListOffsets > 2. We want to emit the metr

Re: [DISCUSS] KIP-1076: Metrics for client applications a KIP-714 extension

All, I had originally planned to call for a vote, but during some early implementation work, I've discovered some changes are necessary. First, we need a reciprocal method to remove a metric from subscriptions, and I've updated the register method to take a single metric. Thanks in advance for ta

[jira] [Resolved] (KAFKA-16335) Remove Deprecated method on StreamPartitioner

[ https://issues.apache.org/jira/browse/KAFKA-16335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-16335. - Resolution: Fixed > Remove Deprecated method on StreamPartitioner >

[jira] [Created] (KAFKA-17427) Fix leaking *_DOC variables in StreamsConfig

Matthias J. Sax created KAFKA-17427: --- Summary: Fix leaking *_DOC variables in StreamsConfig Key: KAFKA-17427 URL: https://issues.apache.org/jira/browse/KAFKA-17427 Project: Kafka Issue Type

Re: [DISCUSS] KIP-1081: Graduation Steps for Features

Hi Colin, Names are in the KIP. Level 1 to 4 are never meant to be used outside of this discussion. It's my, apparently successful, attempt to focus on what the levels mean instead of their names: > Names "In Development" "Early Access" "Preview" "Production Ready" Alternatively

Re: [DISCUSS] KIP-1081: Graduation Steps for Features

On Mon, Aug 26, 2024, at 08:17, Viktor Somogyi-Vass wrote: > Hi all, > > A couple of additional questions/suggestions regarding the KIP: > > VS1. Testing: you wrote about testing only on level 4 but I think we should > add some testing criteria to each one to ensure that it meets > those requiremen

Re: [VOTE]: KIP-1050: Consistent error handling for Transactions

+1 from me Thanks, Justine On Sun, Aug 25, 2024 at 11:54 PM Kaushik Raina wrote: > Hi everyone, > I would like to start a voting thread for KIP-1050: Consistent error > handling for Transactions > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1050%3A+Consistent+error+handling+for+Tra

[jira] [Created] (KAFKA-17426) KRaft should fail if the directory id is not set

José Armando García Sancio created KAFKA-17426: -- Summary: KRaft should fail if the directory id is not set Key: KAFKA-17426 URL: https://issues.apache.org/jira/browse/KAFKA-17426 Project:

Re: [DISCUSS] KIP-1081: Graduation Steps for Features

Hi Viktor, Thanks for your feedback! I agree with your points. I didn't originally want to write it so focused on coding changes so it fits all sorts of KIPs. For example dropping or adding a Scala or Java version, there are no tests (unit, integration or system) needed for the specific change, "

Re: [DISCUSS] KIP-1081: Graduation Steps for Features

Hi all, A couple of additional questions/suggestions regarding the KIP: VS1. Testing: you wrote about testing only on level 4 but I think we should add some testing criteria to each one to ensure that it meets those requirements specified by the given level and it is gradually more mature. For in

[jira] [Resolved] (KAFKA-17352) Upgrade Gradle Enterprise to develocity plugin

[ https://issues.apache.org/jira/browse/KAFKA-17352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Federico Valeri resolved KAFKA-17352. - Resolution: Done > Upgrade Gradle Enterprise to develocity plugin >

Re: [DISCUSS] KIP-1073 Return inactive observer nodes in DescribeQuorum response

Thanks for the KIP Gantigmaa, > { "name": "IncludeFencedBrokers", "type": "bool", "versions": "2+", "about": > "Whether to include fenced brokers." } Did you consider making "includeFencedBroker" field value implicitly based on the DescribeClusterRequest version and the EndpointType? For example

[jira] [Resolved] (KAFKA-17382) cleanup out-of-date configs of config_property

[ https://issues.apache.org/jira/browse/KAFKA-17382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17382. Fix Version/s: 4.0.0 Resolution: Fixed > cleanup out-of-date configs of config_prop

[jira] [Resolved] (KAFKA-17399) Apply LambdaValidator to code base

[ https://issues.apache.org/jira/browse/KAFKA-17399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17399. Fix Version/s: 4.0.0 Resolution: Fixed > Apply LambdaValidator to code base > -

Re: [VOTE] KIP-1077: Deprecate `ForeachProcessor` and move to internal package

thanks for completing this KIP, Kuan-Po ! Kuan Po Tseng 於 2024年8月26日 週一 下午9:47寫道： > Hi everyone, > > I'm closing this vote with the KIP being accepted with 4 binding +1s from > Chia-Ping, Lucas, Bruno, and Matthias, along with 2 non-binding +1s from > TengYao and 黃竣陽. > > Thank you all for your

Re: [VOTE] KIP-1077: Deprecate `ForeachProcessor` and move to internal package

Hi everyone, I'm closing this vote with the KIP being accepted with 4 binding +1s from Chia-Ping, Lucas, Bruno, and Matthias, along with 2 non-binding +1s from TengYao and 黃竣陽. Thank you all for your participation! On 2024/08/22 04:09:06 "Matthias J. Sax" wrote: > +1 (binding) > > On 8/19/24

[jira] [Created] (KAFKA-17425) Improve coexistence of consumer groups and share groups

Andrew Schofield created KAFKA-17425: Summary: Improve coexistence of consumer groups and share groups Key: KAFKA-17425 URL: https://issues.apache.org/jira/browse/KAFKA-17425 Project: Kafka

Re: [PR] KAFKA-17353: Separate unsupported releases in downloads page on website [kafka-site]

fvaleri commented on PR #627: URL: https://github.com/apache/kafka-site/pull/627#issuecomment-2310234575 This is how this change looks like:  -- This is an

Re: [PR] KAFKA-17353: Separate unsupported releases in downloads page on website [kafka-site]

fvaleri commented on PR #627: URL: https://github.com/apache/kafka-site/pull/627#issuecomment-2310236871 @mimaison fyi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[PR] KAFKA-17353: Separate unsupported releases in downloads page on website [kafka-site]

fvaleri opened a new pull request, #627: URL: https://github.com/apache/kafka-site/pull/627 We should have the supported releases at the top clearly identified and list archived releases below. According to the project's EOL policy we support the last 3 releases. -- This is an automated

Re: [DISCUSS] KIP-1027 Add MockFixedKeyProcessorContext

Hi everybody, this KIP is looking good to me. Just note that the release version is set to 3.8 and should probably be updated. Are we ready to open a vote on this one? I do not have any additional comments. Cheers, Lucas On Mon, Jun 24, 2024 at 12:55 AM Shashwat Pandey wrote: > > Totally agree

[jira] [Created] (KAFKA-17424) Memory optimisation for Kafka-connect

Ajit Singh created KAFKA-17424: -- Summary: Memory optimisation for Kafka-connect Key: KAFKA-17424 URL: https://issues.apache.org/jira/browse/KAFKA-17424 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-17423) Replace StandardAuthorizer with Trie implementation

Claude Warren created KAFKA-17423: - Summary: Replace StandardAuthorizer with Trie implementation Key: KAFKA-17423 URL: https://issues.apache.org/jira/browse/KAFKA-17423 Project: Kafka Issue T

Re: [DISCUSS] KIP-1034: Dead letter queue in Kafka Streams

Hi Loïc, Sebastien, and Damien, Now that KIP-1033 is going to be released in 3.9, what is the plan to progress with this KIP? Is the KIP up-to-date, so that we can restart discussion? Best, Bruno On 6/13/24 6:16 PM, Damien Gasparina wrote: Hi Bruno, We focused our effort (well, mostly Seb

[jira] [Resolved] (KAFKA-17373) add print.epoch to kafka-console-share-consumer.sh/kafka-console-consumer.sh

[ https://issues.apache.org/jira/browse/KAFKA-17373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17373. Fix Version/s: 4.0.0 Resolution: Fixed > add print.epoch to kafka-console-share-con

[jira] [Resolved] (KAFKA-17416) Add a checkstyle rule to suppress all generated code

[ https://issues.apache.org/jira/browse/KAFKA-17416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17416. Fix Version/s: 4.0.0 Resolution: Fixed > Add a checkstyle rule to suppress all gene

Re: [DISCUSS] KIP-1081: Graduation Steps for Features

Hi David, Thanks for the feedback! DA1. I'm fine not exposing level 1, but I think it was worth having it for completeness-sake as you mention. This level is probably more of a technicality but my state-machine brain needs the initial state. DA2. Yes, this is the key difference between level 3 a

Re: [DISCUSS] KIP-1081: Graduation Steps for Features

Hi Colin, Thanks for your feedback! > I also don't see what the difference is from a developer's point of view. In both cases, the feature is under development. It seems that we are trying to draw a distinction between the feature being started, and the feature not being started. But this is often

[jira] [Created] (KAFKA-17422) Improve the test time for testDeletionSkippedForSegmentsBeingCopied

Luke Chen created KAFKA-17422: - Summary: Improve the test time for testDeletionSkippedForSegmentsBeingCopied Key: KAFKA-17422 URL: https://issues.apache.org/jira/browse/KAFKA-17422 Project: Kafka

[jira] [Resolved] (KAFKA-17376) Use the new group coordinator by default in 4.0

[ https://issues.apache.org/jira/browse/KAFKA-17376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-17376. - Resolution: Fixed > Use the new group coordinator by default in 4.0 > --

[jira] [Reopened] (KAFKA-14048) The Next Generation of the Consumer Rebalance Protocol

[ https://issues.apache.org/jira/browse/KAFKA-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot reopened KAFKA-14048: - > The Next Generation of the Consumer Rebalance Protocol > -

New Group Coordinator (KIP-848)

Hi folks, I wanted to let you know that the new group coordinator that we developed as part of KIP-848 is now the default group coordinator in trunk (kraft only). Hence all the integration tests, all the system tests and all the kraft clusters created based on trunk use it by default unless specif

[jira] [Resolved] (KAFKA-14048) The Next Generation of the Consumer Rebalance Protocol

[ https://issues.apache.org/jira/browse/KAFKA-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-14048. - Fix Version/s: 4.0.0 Resolution: Fixed > The Next Generation of the Consumer Rebalance Pr

Re: [DISCUSS] KIP-1071: Streams Rebalance Protocol

Hi Nick, NT4. I agree with you that it is more correct to use the most recent offsets. Although, as you already pointed out, a difference between most recent and max should be rare. Best, Bruno On 8/21/24 7:02 PM, Nick Telford wrote: Hi Lucas, NT4. Sounds good, although should it take the

[jira] [Resolved] (KAFKA-16567) Add New Stream Metrics based on KIP-869

[ https://issues.apache.org/jira/browse/KAFKA-16567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lucas Brutschy resolved KAFKA-16567. Resolution: Fixed > Add New Stream Metrics based on KIP-869 >

Re: [VOTE] KIP-1078: Remove Leaking Getter Methods in Joined Helper Class

+1 (binding) On Thu, Aug 22, 2024 at 11:27 PM Bill Bejeck wrote: > > +1 (binding) > > On Thu, Aug 22, 2024 at 2:15 PM Matthias J. Sax wrote: > > > +1 (binding) > > > > On 8/21/24 11:09 PM, 黃竣陽 wrote: > > > +1 (non-binding) > > > > > > Best regard, > > > Jiunn Yang > > > > >

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3234

See

Re: [DISCUSS] KIP-655: Add deduplication processor in kafka-streams

Hi Bill, I think all the points raised are now handled in the KIP. We just still have the 106) on which we should have an agreement. I gave a proposition in my last mail, and I am waiting for others' opinions. My proposition is to have 3 methods of deduplication: 1) `deduplicateByKey()` 2) `dedup