RE: [VOTE] KIP-1034: Dead letter queue in Kafka Streams

Hi everyone, Just a quick reminder that the vote for KIP-1034 is still open. Thank you all for your participation! Best regards, Damien Sebastien and Loic De : Sebastien Viale Envoyé : mercredi 11 septembre 2024 09:26 À : dev Objet : Marketing: [VOTE] KIP-1034

Re: [VOTE] KIP-1043: Administration of groups

Hello Andrew, Thanks for the KIP. +1 (binding) Lianet On Mon, Sep 23, 2024, 3:37 a.m. Lucas Brutschy wrote: > Hi Andrew, > > thanks for the KIP! > > +1 (binding) > > Cheers, > Lucas > > On Mon, Sep 23, 2024 at 9:27 AM Andrew Schofield > wrote: > > > > Hi, > > I would like to start voting for

Re: [VOTE] KIP-1043: Administration of groups

Hi Andrew, Thanks for the KIP, this will be very helpful. +1 (non-binding) Regards, Apoorv Mittal On Mon, Sep 23, 2024 at 11:38 AM Lianet M. wrote: > Hello Andrew, > > Thanks for the KIP. > > +1 (binding) > > Lianet > > On Mon, Sep 23, 2024, 3:37 a.m. Lucas Brutschy > wrote: > > > Hi Andrew,

[DISCUSS] KIP-1093: Add more observability for MirrorMaker2

Hi everyone, I’d like to kick off the discussion of new metrics in MirrorMaker2. https://cwiki.apache.org/confluence/display/KAFKA/KIP-1093%3A+Add+more+observability+for+MirrorMaker2 Feel free to give me any suggestion and feedback. Thanks for your review. Thanks, PoAn

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3327

See

[jira] [Resolved] (KAFKA-17575) TestUtils.tempDirectory registers two shutdown hooks for the same thing

[ https://issues.apache.org/jira/browse/KAFKA-17575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17575. Fix Version/s: 4.0.0 Assignee: Stig Rohde Døssing Resolution: Fixed > Test

Re: [DISCUSS] KIP-1043: Administration of groups

Hi Andrew, Thanks for the KIP. I have some comments/questions: DJ1: In the motivation, you wrote the following: "You can’t see this group in the list of consumer groups with the kafka-consumer-groups.sh tool, but if you try to describe a consumer group called "connect-cluster" or even use this

[VOTE] KIP-1073: Return fenced brokers in DescribeCluster response

Hi everyone, I would like to start voting for KIP-1073 that extends DescribeCluster API to optionally return fenced brokers in the response. https://cwiki.apache.org/confluence/display/KAFKA/KIP-1073%3A+Return+fenced+brokers+in+DescribeCluster+response Thanks. Gantigmaa

Re: [DISCUSS] Apache Kafka 4.0.0 release

+1 and thanks David for volunteering! Best, Chia-Ping Josep Prat 於 2024年9月23日 週一 下午9:13寫道： > Thanks David for volunteering! > +1 > > On Mon, Sep 23, 2024 at 3:11 PM David Jacot > wrote: > > > Hi all, > > > > I would like to volunteer to be the release manager driving the next > > release - Apa

Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

Hi David and Chia-Ping Thank you for your comments, which have helped move the discussion forward. I have updated the content of the KIP accordingly. Please take a look. Sincerely, TengYao Chia-Ping Tsai 於 2024年9月23日 週一 下午11:01寫道： > Hi David > > > I tend to believe that generating a uuid on th

Re: [DISCUSS] Apache Kafka 4.0.0 release

+1, thanks David! On Mon, Sep 23, 2024 at 11:48 AM Satish Duggana wrote: > +1 > Thanks David for volunteering! > > On Mon, 23 Sept 2024 at 19:27, Lianet M. wrote: > > > > +1 > > > > Thanks David! > > > > On Mon, Sep 23, 2024, 9:54 a.m. Justine Olshan > > > wrote: > > > > > +1 and thanks! > > >

Re: [DISCUSS] Apache Kafka 4.0.0 release

+1 Thanks David for volunteering! On Mon, 23 Sept 2024 at 19:27, Lianet M. wrote: > > +1 > > Thanks David! > > On Mon, Sep 23, 2024, 9:54 a.m. Justine Olshan > wrote: > > > +1 and thanks! > > > > On Mon, Sep 23, 2024 at 6:36 AM Chia-Ping Tsai wrote: > > > > > +1 and thanks David for volunteerin

[jira] [Created] (KAFKA-17599) Update Consumer Subscription with Current Assignment Before Partition Revocation

Pritam Kumar created KAFKA-17599: Summary: Update Consumer Subscription with Current Assignment Before Partition Revocation Key: KAFKA-17599 URL: https://issues.apache.org/jira/browse/KAFKA-17599 Proj

[jira] [Resolved] (KAFKA-17471) Speed Up ResetConsumerGroupOffsetTest

[ https://issues.apache.org/jira/browse/KAFKA-17471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 黃竣陽 resolved KAFKA-17471. - Resolution: Won't Fix > Speed Up ResetConsumerGroupOffsetTest > - > >

Re: [DISCUSS] KIP-1043: Administration of groups

Hi David, Thanks for your comments. DJ1: If I start the Confluent schema registry, it creates a classic group called "sr" using the protocol "sr" which is not included in the list from kafka-consumer-groups.sh. If I describe it using kafka-consumer-groups.sh, it says "Error: Consumer group 'sr'

Re: [DISCUSS] Apache Kafka 4.0.0 release

+1, thanks for volunteering David! On Mon, Sep 23, 2024 at 11:56 AM David Arthur wrote: > > +1, thanks David! > > On Mon, Sep 23, 2024 at 11:48 AM Satish Duggana > wrote: > > > +1 > > Thanks David for volunteering! > > > > On Mon, 23 Sept 2024 at 19:27, Lianet M. wrote: > > > > > > +1 > > > > >

Re: [DISCUSS] Apache Kafka 4.0.0 release

Thanks David! +1 On Mon, Sep 23, 2024, 13:07 José Armando García Sancio wrote: > +1, thanks for volunteering David! > > On Mon, Sep 23, 2024 at 11:56 AM David Arthur wrote: > > > > +1, thanks David! > > > > On Mon, Sep 23, 2024 at 11:48 AM Satish Duggana < > satish.dugg...@gmail.com> > > wrote:

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #3328

See

[PR] MINOR: add a space for kafka.metrics.polling.interval.secs description [kafka-site]

m1a2st opened a new pull request, #632: URL: https://github.com/apache/kafka-site/pull/632 As title, there should be a space between in and kafka.metrics.reporters words. 

[VOTE] KIP-1043: Administration of groups

Hi, I would like to start voting for KIP-1043: Administration of groups. This KIP enhances the command-line tools to make it easier to administer groups on clusters with a variety of types of groups. https://cwiki.apache.org/confluence/display/KAFKA/KIP-1043%3A+Administration+of+groups Thanks.

Re: [VOTE] KIP-1043: Administration of groups

Hi Andrew, thanks for the KIP! +1 (binding) Cheers, Lucas On Mon, Sep 23, 2024 at 9:27 AM Andrew Schofield wrote: > > Hi, > I would like to start voting for KIP-1043: Administration of groups. This KIP > enhances the command-line tools to make it easier to administer groups on > clusters wit

Re: [DISCUSS] Apache Kafka 4.0.0 release

+1 and thanks! On Mon, Sep 23, 2024 at 6:36 AM Chia-Ping Tsai wrote: > +1 and thanks David for volunteering! > > Best, > Chia-Ping > > Josep Prat 於 2024年9月23日 週一 下午9:13寫道： > > > Thanks David for volunteering! > > +1 > > > > On Mon, Sep 23, 2024 at 3:11 PM David Jacot > > > wrote: > > > > > Hi

Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

hi David > For instance, we could check whether the member id is already used and we could regenerate another one if it is. However, I tend to believe that the risk of collision within a group is neglectable. I agree the risk is negligible when the member ID is generated by the server, as we can

Re: [DISCUSS] Apache Kafka 4.0.0 release

+1 Thanks David! On Mon, Sep 23, 2024, 9:54 a.m. Justine Olshan wrote: > +1 and thanks! > > On Mon, Sep 23, 2024 at 6:36 AM Chia-Ping Tsai wrote: > > > +1 and thanks David for volunteering! > > > > Best, > > Chia-Ping > > > > Josep Prat 於 2024年9月23日 週一 下午9:13寫道： > > > > > Thanks David for vol

[jira] [Created] (KAFKA-17591) Consumer protocol subscription regex support

Lianet Magrans created KAFKA-17591: -- Summary: Consumer protocol subscription regex support Key: KAFKA-17591 URL: https://issues.apache.org/jira/browse/KAFKA-17591 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-17592) Support for subscription regex in HB RPC

Lianet Magrans created KAFKA-17592: -- Summary: Support for subscription regex in HB RPC Key: KAFKA-17592 URL: https://issues.apache.org/jira/browse/KAFKA-17592 Project: Kafka Issue Type: Sub-

[jira] [Created] (KAFKA-17593) Async regex resolution

Lianet Magrans created KAFKA-17593: -- Summary: Async regex resolution Key: KAFKA-17593 URL: https://issues.apache.org/jira/browse/KAFKA-17593 Project: Kafka Issue Type: Sub-task R

Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

Hi Chia-Ping, > However, my concern is that consumers are now required to generate the member ID, so as a responsible server, we need to handle the incorrect client behavior. At least, based on David's comment, we can create another member id when it is already used and it is rejoining the group (

[jira] [Created] (KAFKA-17594) Integrate resolved regexes in assignment computation

Lianet Magrans created KAFKA-17594: -- Summary: Integrate resolved regexes in assignment computation Key: KAFKA-17594 URL: https://issues.apache.org/jira/browse/KAFKA-17594 Project: Kafka Issu

[jira] [Created] (KAFKA-17595) Stored regexes refresh to reflect metadata changes

Lianet Magrans created KAFKA-17595: -- Summary: Stored regexes refresh to reflect metadata changes Key: KAFKA-17595 URL: https://issues.apache.org/jira/browse/KAFKA-17595 Project: Kafka Issue

[jira] [Created] (KAFKA-17596) Benchmark regex resolution

Lianet Magrans created KAFKA-17596: -- Summary: Benchmark regex resolution Key: KAFKA-17596 URL: https://issues.apache.org/jira/browse/KAFKA-17596 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-17495) Factor out common setup from server-side assignor benchmarks

[ https://issues.apache.org/jira/browse/KAFKA-17495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-17495. - Fix Version/s: 4.0.0 Resolution: Fixed > Factor out common setup from server-side assigno

[jira] [Created] (KAFKA-17597) Update OffsetsMetadataManager to consider topics subscribed from regex

Lianet Magrans created KAFKA-17597: -- Summary: Update OffsetsMetadataManager to consider topics subscribed from regex Key: KAFKA-17597 URL: https://issues.apache.org/jira/browse/KAFKA-17597 Project: K

Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

Hi David > I tend to believe that generating a uuid on the client should not be that difficult so I am not too concerned about it. How do you see this, You're right. It's not that difficult, and we should have more confidence in third-party libraries. hi TengYao Could you please summarize the d

[jira] [Created] (KAFKA-17598) Command line validation tool for RE2J regex

Lianet Magrans created KAFKA-17598: -- Summary: Command line validation tool for RE2J regex Key: KAFKA-17598 URL: https://issues.apache.org/jira/browse/KAFKA-17598 Project: Kafka Issue Type: S

[jira] [Created] (KAFKA-17590) ReplicaFetcher throw CorruptRecordException

ChenLin created KAFKA-17590: --- Summary: ReplicaFetcher throw CorruptRecordException Key: KAFKA-17590 URL: https://issues.apache.org/jira/browse/KAFKA-17590 Project: Kafka Issue Type: Bug C

Re: [DISCUSS] KIP-1082: Enable ID Generation for Clients over the ConsumerGroupHeartbeat RPC

Hi Chia-Ping, > Checks whether the member epoch matches the member epoch in its current assignment. FENCED_MEMBER_EPOCH is returned otherwise. The member is also removed from the group. We did not implement it like this in the end. We keep the member and only request him to re-synchronise himself

Re: [DISCUSS] Apache Kafka 4.0.0 release

Thanks, David! +1 Best, Bruno On 9/23/24 3:10 PM, David Jacot wrote: Hi all, I would like to volunteer to be the release manager driving the next release - Apache Kafka 4.0.0. If there are no objections, I'll start building a release plan in the wiki in the next couple of days. Best, David

[DISCUSS] Apache Kafka 4.0.0 release

Hi all, I would like to volunteer to be the release manager driving the next release - Apache Kafka 4.0.0. If there are no objections, I'll start building a release plan in the wiki in the next couple of days. Best, David

Re: [DISCUSS] Apache Kafka 4.0.0 release

Thanks David for volunteering! +1 On Mon, Sep 23, 2024 at 3:11 PM David Jacot wrote: > Hi all, > > I would like to volunteer to be the release manager driving the next > release - Apache Kafka 4.0.0. > > If there are no objections, I'll start building a release plan in the wiki > in the next cou

[jira] [Resolved] (KAFKA-16054) Sudden 100% CPU on a broker

[ https://issues.apache.org/jira/browse/KAFKA-16054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleksandr Shulgin resolved KAFKA-16054. --- Resolution: Not A Bug > Sudden 100% CPU on a broker > --- >

RE: [VOTE] KIP-1052: Enable warmup in producer performance test

Hi Kafka Devs, Bumping VOTE thread again for visibility. Thanks to Justine and Federico who've cast their votes on KIP-1052! Current vote tally: Justine Olshan: +1 (binding) Federico Valeri: +1 (non-binding) Let's keep it going and complete this vote! Thanks, Matt -Origina

Re: [VOTE] KIP-1064 - Upgrade slf4j to 2.x

Hi, I wanted to gently follow up on this thread in case anyone has any thoughts or would like to take a look. Thanks, Murali On Mon, Sep 16, 2024 at 10:23 AM Muralidhar Basani < muralidhar.bas...@aiven.io> wrote: > Thanks Chia. > > I have updated KIP with this quote, in the migration plan secti

Re: New release branch 3.9

KAFKA-17584 looks like an issue with our handling of configuration synonyms. I have created a PR here. https://github.com/apache/kafka/pull/17258 I think we can get this into RC1 if we hurry. On a related note, now that 3.9 RC0 is out, please consider dropping JDK8 and removing ZK support as unb

Re: New release branch 3.9

Thanks Chia-Ping Tsai! Please do backport the test fix to the 3.9 branch if we can get it in soon. (I don't think it's a blocker though...) best, Colin On Sun, Sep 22, 2024, at 05:29, Chia-Ping Tsai wrote: > hi Colin > > The `reassign_partitions_test.py` is unstable in 3.9 on my local, and > ht

Re: [DISCUSS] KIP-1092: Extend Consumer#close with an option to leave the group or not

Hi TengYao, Thanks for writing up this KIP :) Questions: KT1: Why would a non-Kafka Streams application want to set leaveGroup=false? Because Kafka Streams manages the group membership assignment under the covers, it can re-assign partitions to a new Consumer when the old one closes. But in a

Re: [DISCUSS] - Kafka topic deletion improvement

Hi Jose, You're right, ACLs are typically created before topic creation to prevent authorization issues during deployment. However, when it comes to deleting a topic via CLI, it's really just two steps: running the topic deletion command and the ACL deletion command. I had considered combining th