Re: [VOTE] KIP-1068: New metrics for the new KafkaConsumer

Hi Brenden, Thanks for the KIP! +1 (binding) Best, Bruno On 7/24/24 11:55 PM, Brenden Deluna wrote: Hello everyone, I would like to start the vote on KIP-1068: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1068%3A+New+metrics+for+the+new+KafkaConsumer This KIP introduces new metrics

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

> > I am ok with adding a note in the KIP but the note should say that it has > an elevated risk for this scenario due to increased probability of having > an aggressive local cleanup with Tiered Storage. > I would like to clarify that there is no elevated risk because of this KIP. This risk alrea

[jira] [Created] (KAFKA-17200) Enable MM2 to replicate topics ending in "internal" suffix

Patrik Márton created KAFKA-17200: - Summary: Enable MM2 to replicate topics ending in "internal" suffix Key: KAFKA-17200 URL: https://issues.apache.org/jira/browse/KAFKA-17200 Project: Kafka

Re: [VOTE] KIP-950: Tiered Storage Disablement

Hi all, While implementing the feature in KRaft mode, I found something we need to change the original proposal: (1) In the KIP of "Disablement - KRaft backed Cluster

[jira] [Resolved] (KAFKA-17195) transaction-coordinator:test failing with junit error

[ https://issues.apache.org/jira/browse/KAFKA-17195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17195. Resolution: Fixed > transaction-coordinator:test failing with junit error > --

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3138

See

Re: [VOTE] KIP-950: Tiered Storage Disablement

Hi all, I just found the table is not able to be displayed correctly in the email. I've put the table content in google doc here . Thanks. Luke On Thu, Jul 25, 2024 at 6:30 PM Luke Chen wrote: >

Re: [VOTE] KIP-950: Tiered Storage Disablement

Hello! Thank you for raising this! Up to now KIP-950 took the stance that you can disable tiering whenever you wish as long as you specify what you would like to do with the data in remote. Amongst other things it also made the promise that it will not delete data without a user explicitly saying

Re: [VOTE] KIP-950: Tiered Storage Disablement

Hi Christo, Thanks for your reply. > keep the remote.log.disable.policy, but only allow it to take a value of "delete". I agree, or maybe make it a boolean value, and rename it to `remote.log.delete.on.disable`, which is clearer. And because of this new config, there will be a case that the conf

[DISCUSS] KIP-1073 Return inactive observer nodes in DescribeQuorum response

Hi everyone, I would like to start a discussion on KIP-1073 that includes inactive observer nodes in the response for describeQuorum request. https://cwiki.apache.org/confluence/display/KAFKA/KIP-1073%3A+Return+inactive+observer+nodes+in+DescribeQuorum+response The initial discussion on this issu

Re: [VOTE] KIP-1068: New metrics for the new KafkaConsumer

Hi Brenden, +1 (non-binding) from me. Thanks for the KIP! Lianet On Thu, Jul 25, 2024 at 3:18 AM Bruno Cadonna wrote: > Hi Brenden, > > Thanks for the KIP! > > +1 (binding) > > Best, > Bruno > > On 7/24/24 11:55 PM, Brenden Deluna wrote: > > Hello everyone, > > > > I would like to start the v

Re: [VOTE] KIP-950: Tiered Storage Disablement

remote.storage.enable=false remote.log.delete.on.disable=false (default) If the topic config is set to this, or changed to this, we'll return ConfigException during validation. Pardon me, I'm a bit confused. when `remote.storage.enable=true`, `remote.log.delete.on.disable=false` is no-op when `re

Re: [DISCUSS] KIP-1050: Consistent error handling for Transactions

Additionally, - We will be depreciating KIP-691 in favour of KIP-1050. On Fri, Jun 21, 2024 at 12:20 PM Kaushik Raina wrote: > Thanks Matthias for feedback > - We have updates KIP and grouped exceptions > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1050%3A+Consistent+error+handling+fo

Re: [VOTE] KIP-1068: New metrics for the new KafkaConsumer

Hi Brenden, Thanks for the KIP. +1 (non-binding). P On Thu, Jul 25, 2024 at 6:25 AM Lianet M. wrote: > Hi Brenden, > > +1 (non-binding) from me. > > Thanks for the KIP! > > Lianet > > On Thu, Jul 25, 2024 at 3:18 AM Bruno Cadonna wrote: > > > Hi Brenden, > > > > Thanks for the KIP! > > > > +1

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3139

See

Re: [VOTE] 3.8.0 RC3

Hi Josep, Thanks for the release candidate. +1 (non-binding) I tested and verified the docker image artifact apache/kafka-native:3.8.0-rc3 - verified create topic, produce messages and consume messages flow. - verified the html documentation for docker image. I also ran the System tests by brin

Re: [VOTE] KIP-950: Tiered Storage Disablement

Hi Chia-Ping, Thanks for the review! > If so, what is the purpose of `remote.log.delete.on.disable=false`? IIUC, the purpose of `remote.log.delete.on.disable` is to get explicit confirmation from the user before deleting the remote log segments. The concern raised in the thread is that if the u

Re: [VOTE] KIP-950: Tiered Storage Disablement

Correction: (2): Wait for all the remote segments to be deleted async due to breach by retention time (or) size, then set the `remote.storage.enable = false` and `remote.log.delete.on.disable = true`. This step is optional. On Thu, Jul 25, 2024 at 11:13 PM Kamal Chandraprakash < kamal.chan

[jira] [Resolved] (KAFKA-17054) test

[ https://issues.apache.org/jira/browse/KAFKA-17054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-17054. - Resolution: Invalid > test > > > Key: KAFKA-17054 >

[jira] [Created] (KAFKA-17201) SelectorTest.testInboundConnectionsCountInConnectionCreationMetric leaks sockets and threads

Greg Harris created KAFKA-17201: --- Summary: SelectorTest.testInboundConnectionsCountInConnectionCreationMetric leaks sockets and threads Key: KAFKA-17201 URL: https://issues.apache.org/jira/browse/KAFKA-17201

Re: [DISCUSS] KIP-512: make Record Headers available in onAcknowledgement

Rich, thanks for resurrecting this KIP. I was not part of the original discussion back in the day, but personally agree with your assessment that making headers available in the callbacks would make developer's life much simpler. For the KIP itself, starting with "Public Interface" section,

[jira] [Created] (KAFKA-17202) EosIntegrationTest.verifyChangelogMaxRecordOffsetMatchesCheckpointedOffset leaks consumers

Greg Harris created KAFKA-17202: --- Summary: EosIntegrationTest.verifyChangelogMaxRecordOffsetMatchesCheckpointedOffset leaks consumers Key: KAFKA-17202 URL: https://issues.apache.org/jira/browse/KAFKA-17202

Re: [VOTE] KIP-1068: New metrics for the new KafkaConsumer

Hi Brenden, The metrics look good. Thanks for the KIP. +1 (Non-Binding) Regards, Apoorv Mittal On Thu, Jul 25, 2024 at 5:04 PM Philip Nee wrote: > Hi Brenden, > > Thanks for the KIP. +1 (non-binding). > > P > > On Thu, Jul 25, 2024 at 6:25 AM Lianet M. wrote: > > > Hi Brenden, > > > > +1 (no

[jira] [Created] (KAFKA-17203) StreamThread leaking producer instances

Greg Harris created KAFKA-17203: --- Summary: StreamThread leaking producer instances Key: KAFKA-17203 URL: https://issues.apache.org/jira/browse/KAFKA-17203 Project: Kafka Issue Type: Test

[jira] [Created] (KAFKA-17204) KafkaStreamsCloseOptionsIntegrationTest.before leaks AdminClient

Greg Harris created KAFKA-17204: --- Summary: KafkaStreamsCloseOptionsIntegrationTest.before leaks AdminClient Key: KAFKA-17204 URL: https://issues.apache.org/jira/browse/KAFKA-17204 Project: Kafka

Re: [DISCUSS] KIP-512: make Record Headers available in onAcknowledgement

Hi Kevin, Thanks for your support. Hi Matthias, I apologize for the confusion. I've deleted the Public Interface sections for now. I think we should focus on discussing its necessity with the community. I'll let it sit for a few more days, and if there are no objections, I will propose changes o