[jira] [Created] (KAFKA-15064) Use KafkaTemplate to send message with below exception - IllegalMonitorStateException

Xuguang zhan created KAFKA-15064: Summary: Use KafkaTemplate to send message with below exception - IllegalMonitorStateException Key: KAFKA-15064 URL: https://issues.apache.org/jira/browse/KAFKA-15064

Re: [ANNOUNCE] Apache Kafka 3.4.1

Thanks Luke! On Wed, Jun 7, 2023 at 5:56 AM Kamal Chandraprakash wrote: > > Thanks Luke for running this release! > > On Wed, Jun 7, 2023 at 8:08 AM Chia-Ping Tsai wrote: > > > Thank Luke for this hard work!!! > > > > > Chris Egerton 於 2023年6月7日 上午10:35 寫道： > > > > > > Thanks for running this r

Re: [ANNOUNCE] Apache Kafka 3.4.1

Thanks for running the release! Best, ——— Josep Prat Aiven Deutschland GmbH Alexanderufer 3-7, 10117 Berlin Amtsgericht Charlottenburg, HRB 209739 B Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen m: +491715557497 w: aiven.io e: josep.p...@aiven.io On Wed, Jun 7, 2023, 05:57 Kamal Chan

Re: [DISCUSS] KIP-935: Extend AlterConfigPolicy with existing configurations

On Tue, Jun 6, 2023, at 06:57, Jorge Esteban Quilcate Otoya wrote: > Thanks Colin. > >> I would suggest renaming the "configs" parameter to "proposedConfigs," in > both the new and old RequestMetadata constructors, to make things clearer. > This would be a binary and API-compatible change in Java.

Re: [VOTE] KIP-938: Add more metrics for measuring KRaft performance

Hi all, I added two new metrics to the list: * LatestSnapshotGeneratedBytes * LatestSnapshotGeneratedAgeMs These will help monitor the period snapshot generation process. best, Colin On Tue, Jun 6, 2023, at 22:21, Colin McCabe wrote: > Hi Divij, > > Yes, I am referring to the feature level. I

Re: [VOTE] KIP-938: Add more metrics for measuring KRaft performance

Hi Divij, Yes, I am referring to the feature level. I changed the description of CurrentMetadataVersion to reference the feature level specifically. best, Colin On Tue, Jun 6, 2023, at 05:56, Divij Vaidya wrote: > "Each metadata version has a corresponding integer in the > MetadataVersion.java

Re: [ANNOUNCE] Apache Kafka 3.4.1

Thanks Luke for running this release! On Wed, Jun 7, 2023 at 8:08 AM Chia-Ping Tsai wrote: > Thank Luke for this hard work!!! > > > Chris Egerton 於 2023年6月7日 上午10:35 寫道： > > > > Thanks for running this release, Luke! > > > > On Tue, Jun 6, 2023, 22:31 Luke Chen wrote: > > > >> The Apache Kafka

Re: [ANNOUNCE] Apache Kafka 3.4.1

Thank Luke for this hard work!!! > Chris Egerton 於 2023年6月7日 上午10:35 寫道： > > Thanks for running this release, Luke! > > On Tue, Jun 6, 2023, 22:31 Luke Chen wrote: > >> The Apache Kafka community is pleased to announce the release for >> Apache Kafka 3.4.1. >> >> This is a bug fix release an

Re: [ANNOUNCE] Apache Kafka 3.4.1

Thanks for running this release, Luke! On Tue, Jun 6, 2023, 22:31 Luke Chen wrote: > The Apache Kafka community is pleased to announce the release for > Apache Kafka 3.4.1. > > This is a bug fix release and it includes fixes and improvements from > 58 JIRAs, including a few critical bugs: > - co

[ANNOUNCE] Apache Kafka 3.4.1

The Apache Kafka community is pleased to announce the release for Apache Kafka 3.4.1. This is a bug fix release and it includes fixes and improvements from 58 JIRAs, including a few critical bugs: - core KAFKA-14644 Process should stop after failure in raft IO thread KAFKA-14946 KRaft controller n

[GitHub] [kafka-site] showuon merged pull request #519: MINOR: Add Kafka 3.4.1 documentation and javadoc and download link

showuon merged PR #519: URL: https://github.com/apache/kafka-site/pull/519 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1904

See

Re: [DISCUSS] Adding non-committers as Github collaborators

Thanks John for looking into this! Hao On Tue, Jun 6, 2023 at 8:32 AM John Roesler wrote: > Hello all, > > I put in a ticket with Apache Infra to re-send these invites, and they > told me I should just remove the usernames in one commit and then re-add > them in a subsequent commit to trigger t

Re: [DISCUSS] Adding non-committers as Github collaborators

Got the invite and was able to accept. Thanks a lot John! On Tue, Jun 6, 2023 at 6:11 PM Greg Harris wrote: > John, > > I saw the invite be re-sent, and accepted it. > > Thanks for following up! > Greg > > On Tue, Jun 6, 2023 at 3:08 PM John Roesler wrote: > > > > Hello Greg, Andrew, and Victo

Re: [DISCUSS] Adding non-committers as Github collaborators

John, I saw the invite be re-sent, and accepted it. Thanks for following up! Greg On Tue, Jun 6, 2023 at 3:08 PM John Roesler wrote: > > Hello Greg, Andrew, and Victoria, > > I have just re-added you to the file, so you should receive new invites. > Please let us know if you have any trouble!

Re: [DISCUSS] Adding non-committers as Github collaborators

Hello Greg, Andrew, and Victoria, I have just re-added you to the file, so you should receive new invites. Please let us know if you have any trouble! Thanks, -John On Tue, Jun 6, 2023, at 10:31, John Roesler wrote: > Hello all, > > I put in a ticket with Apache Infra to re-send these invites,

Re: [DISCUSS] Adding non-committers as Github collaborators

Hi Divij, Interesting; perhaps they didn't need to send you an invite because your github account is already associated with another Apache project? The actions you listed are the things that the collaborator role gives you, so I think you're good to go. Thanks, -John On Tue, Jun 6, 2023, at

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1903

See Changes: -- [...truncated 575522 lines...] [2023-06-06T21:54:42.133Z] [2023-06-06T21:54:42.133Z] > Task :streams:javadoc [2023-06-06T21:54:43.061Z] > Task :streams:jav

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

Handling the "changelog" topic for the buffer in the same way as repartition topics makes sense. Thanks for clearing that up! - Victoria On Tue, Jun 6, 2023 at 10:22 AM Walker Carlson wrote: > Good Point Victoria. I just removed the compacted topic mention from the > KIP. I agree with Burno abo

Re: [VOTE] 3.5.0 RC1

+1 (non-binding) ... I used the staged binaries with Scala 2.13 and staged artifacts to run my tests. All seems to work fine. Thanks for running the release Mickael! Jakub On Mon, Jun 5, 2023 at 3:39 PM Mickael Maison wrote: > Hello Kafka users, developers and client-developers, > > This is th

Re: [DISCUSS] Partial CI builds - Reducing flakiness with fewer tests

David, Thanks for your thoughts! > Indeed, they will be more likely to pass but the > downside is that folks may start to only rely on that signal and commit > without looking at the full test suite. This seems dangerous to me. I completely agree with you that it is not desirable for committers

Re: [VOTE] 3.5.0 RC1

Hi Mickael, I did the following checks: - Signature, checksum, licenses - Build from source with Java 17 and Scala 2.13 - Full unit and integration test suites - Java app with staging Maven artifacts and multi-node cluster LGTM, apart from the already mentioned "classgraph" license that can be re

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1902

See

Re: [VOTE] KIP-923: Add A Grace Period to Stream Table Join

Hi all, This vote thread has been open over 72 hours, and has sufficient votes so I'll close the voting at this time. +4 binding votes +2 non-binding votes KIP-923 has PASSED. Thanks all for your votes Walker On Tue, Jun 6, 2023 at 8:13 AM John Roesler wrote: > Thanks for the KIP, Walker! >

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

Good Point Victoria. I just removed the compacted topic mention from the KIP. I agree with Burno about using a normal topic and deleting records that have been processed. On Tue, Jun 6, 2023 at 2:28 AM Bruno Cadonna wrote: > Hi, > > another idea that came to my mind. Instead of using a compacted

Re: [DISCUSS] Regarding Old PRs

Hi Josep, Thanks for bringing this up! Will try to keep things brief. I'm generally in favor of this initiative. A couple ideas that I really liked: requiring a component label (producer, consumer, connect, streams, etc.) before closing, and disabling auto-close (i.e., automatically tagging PRs a

Re: [DISCUSS] KIP-936: Throttle number of active PIDs

Hi, Omnia. Thanks for the KIP. The feature sounds indeed helpful and the strategy to use bloom-filter looks good. I have three questions: 1. Do you have any memory-footprint estimation for TimeControlledBloomFilter? * If I read the KIP correctly, TimeControlledBloomFilter will be allocated p

Re: [DISCUSS] Adding non-committers as Github collaborators

Hey John What does the invite do? I did not receive any invite either but I have been able to add labels, close PRs etc. since I was added to the contributors list (perhaps because I already have an apache LDAP account?). I am working with the assumption that things are working for me even if I di

[jira] [Reopened] (KAFKA-15021) KRaft controller increases leader epoch when shrinking ISR

[ https://issues.apache.org/jira/browse/KAFKA-15021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio reopened KAFKA-15021: > KRaft controller increases leader epoch when shrinking ISR > ---

[jira] [Resolved] (KAFKA-15021) KRaft controller increases leader epoch when shrinking ISR

[ https://issues.apache.org/jira/browse/KAFKA-15021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] José Armando García Sancio resolved KAFKA-15021. Resolution: Fixed > KRaft controller increases leader epoch when s

Re: [DISCUSS] Adding non-committers as Github collaborators

Hello all, I put in a ticket with Apache Infra to re-send these invites, and they told me I should just remove the usernames in one commit and then re-add them in a subsequent commit to trigger the invites again. I will go ahead and do this for the users who requested it on this thread (Greg a

[jira] [Resolved] (KAFKA-14791) Create a builder class for PartitionRegistration

[ https://issues.apache.org/jira/browse/KAFKA-14791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Grant resolved KAFKA-14791. -- Resolution: Fixed > Create a builder class for PartitionRegistration > ---

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1901

See Changes: -- [...truncated 481169 lines...] [2023-06-06T14:59:51.388Z] [WARNING] Plugin validation issues were detected in 2 plugin(s) [2023-06-06T14:59:51.388Z] [WARNI

[DISCUSS] KIP-936: Throttle number of active PIDs

Hi everyone, I want to start the discussion of the KIP-936 to throttle the number of active PIDs per KafkaPrincipal. The proposal is here https://cwiki.apache.org/confluence/display/KAFKA/KIP-936%3A+Throttle+number+of+active+PIDs

[jira] [Created] (KAFKA-15063) Throttle number of active PIDs

Omnia Ibrahim created KAFKA-15063: - Summary: Throttle number of active PIDs Key: KAFKA-15063 URL: https://issues.apache.org/jira/browse/KAFKA-15063 Project: Kafka Issue Type: New Feature

Re: [DISCUSS] KIP-934: Add DeleteTopicPolicy

Thank Colin. > One last note: if we do this, we should pass the UUID of the topic as well as the name. Sure, adding it to the KIP. > On the minus side, the stated use-case (preventing deletion of __consumer_offsets) seems easy to solve via ACLs. The CreateTopics case is different... it's not as

Re: [DISCUSS] KIP-918: MM2 Topic And Group Listener

Hi Daniel, Thanks for the KIP! I see the value in exposing information on replicated topics and groups. For one, it matches a similar feature added to Kafka Connect in KIP-558 [1], where we started tracking the set of topics that connectors interacted with over their lifetime. And there's also the

Re: [DISCUSS] Regarding Old PRs

Hi Josep, Thanks for looking into this. This is clearly one aspect where we need to improve. We had a similar initiative last year (https://lists.apache.org/thread/66yj9m6tcyz8zqb3lqlbnr386bqwsopt) and we closed many PRs. Unfortunately we did not follow up with a process or automation and we are

Re: [DISCUSS] solutions for broker OOM caused by many producer IDs

Thanks, Luke for the feedback 1. how do we store value in bloom filter? It's unclear from this KIP that > what we store inside bloom filter, and how we throttle them. > My understanding is, we have a map with key = kafkaPrinciple, and value = > PID for each bloom filter. > And when new PID created

Re: [DISCUSS] KIP-935: Extend AlterConfigPolicy with existing configurations

Thanks Colin. > I would suggest renaming the "configs" parameter to "proposedConfigs," in both the new and old RequestMetadata constructors, to make things clearer. This would be a binary and API-compatible change in Java. Sure, fully agree. KIP is updated with this suggestion. > We should also

Re: [VOTE] KIP-923: Add A Grace Period to Stream Table Join

Thanks for the KIP, Walker! I’m +1 (binding) Thanks, John On Mon, Jun 5, 2023, at 13:39, Victoria Xia wrote: > Hi Walker, > > Thanks for the KIP! Left a clarification question on the discussion thread > just now but it's about an implementation detail, so I don't think it > changes anything in t

Re: [VOTE] KIP-938: Add more metrics for measuring KRaft performance

"Each metadata version has a corresponding integer in the MetadataVersion.java file." Please correct me if I'm wrong, but are you referring to "featureLevel" in the enum at https://github.com/apache/kafka/blob/trunk/server-common/src/main/java/org/apache/kafka/server/common/MetadataVersion.java#L4

Re: [DISCUSS] KIP-937 Improve Message Timestamp Validation

Hi Luke Thank you for your participation in reviewing this KIP. #1 Updated the KIP with correct configuration names and hyperlinks. #2 Yes, the semantics change from a perspective that the difference is always in the past (or at most 1 hour into the future). Updated the compatibility section to

[GitHub] [kafka-site] showuon commented on a diff in pull request #519: MINOR: Add Kafka 3.4.1 documentation and javadoc and download link

showuon commented on code in PR #519: URL: https://github.com/apache/kafka-site/pull/519#discussion_r1219517807 ## 34/javadoc/search.js: ## @@ -1,26 +1,26 @@ /* * Copyright (c) 2015, 2020, Oracle and/or its affiliates. All rights reserved. - * DO NOT ALTER OR REMOVE COPYRIGHT

[GitHub] [kafka-site] showuon commented on a diff in pull request #519: MINOR: Add Kafka 3.4.1 documentation and javadoc and download link

showuon commented on code in PR #519: URL: https://github.com/apache/kafka-site/pull/519#discussion_r1219517284 ## 34/javadoc/script.js: ## @@ -1,26 +1,26 @@ /* * Copyright (c) 2013, 2020, Oracle and/or its affiliates. All rights reserved. - * DO NOT ALTER OR REMOVE COPYRIGHT

[GitHub] [kafka-site] mimaison merged pull request #518: MINOR: Update upgrade to 3.5 section

mimaison merged PR #518: URL: https://github.com/apache/kafka-site/pull/518 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@kafka.apache

Re: [VOTE] KIP-938: Add more metrics for measuring KRaft performance

Thanks again for the KIP, Colin. +1 (binding). Ron > On Jun 6, 2023, at 7:02 AM, Igor Soarez wrote: > > Thanks for the KIP. > > Seems straightforward, LGTM. > Non binding +1. > > -- > Igor >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1900

See Changes: -- [...truncated 384548 lines...] [2023-06-06T11:22:41.332Z] [2023-06-06T11:22:41.332Z] Gradle Test Run :streams:integrationTest > Gradle Test Executor 181 >

[GitHub] [kafka-site] jlprat commented on a diff in pull request #519: MINOR: Add Kafka 3.4.1 documentation and javadoc and download link

jlprat commented on code in PR #519: URL: https://github.com/apache/kafka-site/pull/519#discussion_r1219433080 ## 34/javadoc/search.js: ## @@ -1,26 +1,26 @@ /* * Copyright (c) 2015, 2020, Oracle and/or its affiliates. All rights reserved. - * DO NOT ALTER OR REMOVE COPYRIGHT

Re: [VOTE] KIP-938: Add more metrics for measuring KRaft performance

Thanks for the KIP. Seems straightforward, LGTM. Non binding +1. -- Igor

Re: [VOTE] 3.4.1 RC3

Hi Prem, You can follow the instructions here if you wish to unsubscribe from one or more mailing lists - https://kafka.apache.org/contact On Tue, Jun 6, 2023 at 2:44 PM Prem Sagar wrote: > Please remove my mail ID from the database. > > > Warm Regards > K Prem Sagar > Sr.Manager - Procurements

[jira] [Created] (KAFKA-15062) Power(ppc64le) support for Kafka

Vaibhav created KAFKA-15062: --- Summary: Power(ppc64le) support for Kafka Key: KAFKA-15062 URL: https://issues.apache.org/jira/browse/KAFKA-15062 Project: Kafka Issue Type: Task Components:

Re: [DISCUSS] Partial CI builds - Reducing flakiness with fewer tests

Hey Greg, Thanks for bringing this up. I am not sure to understand the benefit of the parallele trigger of a subset of the tests. Indeed, they will be more likely to pass but the downside is that folks may start to only rely on that signal and commit without looking at the full test suite. This s

Re: [DISCUSS] KIP-937 Improve Message Timestamp Validation

Hi Beyene, Thanks for the KIP. Questions: 1. We don't have "*max.message.time.difference.ms *" config, I think you're referring to "log.message.timestamp.difference.max.ms"? 2. After this KIP, the semantics of "log.message.timestamp.difference.max.ms" will b

Re: [DISCUSS] Regarding Old PRs

Hi Devs, I would say we can split the problem in 2. Waiting for Author feedback: We could have a bot that would ping authors for the cases where we have PRs that are stalled and have either: - Merge conflict - Unaddressed reviews Waiting for reviewers: For the PRs where we have no reviewers and t

Re: [DISCUSS] Regarding Old PRs

Hi Nikolay, With a bot it will be complicated to determine what to do when the PR author is waiting for a reviewer. If a person goes over them, can check if they are waiting for reviews and tag the PR accordingly and maybe ping a maintainer. If you look at my last email I described a flow (but AFA

Re: [DISCUSS] Regarding Old PRs

Hello. What is actions of contributor if no feedback given? [1], [2] [1] https://github.com/apache/kafka/pull/13278 [2] https://github.com/apache/kafka/pull/13247 > 2 июня 2023 г., в 23:38, David Arthur написал(а): > > I think this is a great idea. If we don’t want the auto-close > functional

Re: [DISCUSS] solutions for broker OOM caused by many producer IDs

Hi Omnia, I finally got time to check this KIP. Thanks for putting all this together. Questions: 1. how do we store value in bloom filter? It's unclear from this KIP that what we store inside bloom filter, and how we throttle them. My understanding is, we have a map with key = kafkaPrinciple, and

hardware and software requirements to build Apache Kafka

Hi All, We are working to build Apache Kafka. We require hardware requirement to build Apache Kafka as CPU core machine, RAM and H/W memory. Request to share info. Thanks in advance. With Regards, Prasanna

Re: [VOTE] 3.4.1 RC3

Please remove my mail ID from the database. Warm Regards K Prem Sagar Sr.Manager - Procurements M: + 91 - 9100939886 p...@pidatacenters.com Amaravati | Bengaluru | Chennai | Delhi | Hyderabad | Kochi | Mumbai

Re: [VOTE] 3.4.1 RC3

Why this mail is marked to me ? Warm Regards K Prem Sagar Sr.Manager - Procurements M: + 91 - 9100939886 p...@pidatacenters.com Amaravati | Bengaluru | Chennai | Delhi | Hyderabad | Kochi | Mumbai

Re: [VOTE] 3.5.0 RC1

Hi Mickael, I ran the following validation steps: - Built from source with Java 17 and Scala 2.13 - Signatures and hashes of the artifacts generated - Navigated through Javadoc including links to JDK classes - Run the quickstart in KRaft and Zookeeper mode +1 (binding) from me. Thanks for running

Re: [DISCUSS] KIP-923: Add A Grace Period to Stream Table Join

Hi, another idea that came to my mind. Instead of using a compacted topic, the buffer could use a non-compacted topic and regularly delete records before a given offset as Streams does for repartition topics. Best, Bruno On 05.06.23 21:48, Bruno Cadonna wrote: Hi Victoria, that is a good p