Jenkins build is back to stable : Kafka » Kafka PowerPC Daily » test-powerpc #83

See

Re: New release branch 3.9

Thanks for the PR, Josep. I don't think it's critical to re-generate the RC since we can simply update the docs on the website later as we've done in the past. If there is a new RC after RC2, it will be there, though. Also it looks like this will be a good fix for 3.8.1 as well :) best, Colin

[jira] [Created] (KAFKA-17772) Remove inControlledShutdownBrokers(Set) and unfenceBrokers(Set) from ReplicationControlManagerTest

Chia-Ping Tsai created KAFKA-17772: -- Summary: Remove inControlledShutdownBrokers(Set) and unfenceBrokers(Set) from ReplicationControlManagerTest Key: KAFKA-17772 URL: https://issues.apache.org/jira/browse/KAFKA-1

Re: [DISCUSS] Apache Kafka 3.7.2 release

+1 Thanks, Matthias > Lianet M. 於 2024年10月11日 凌晨12:14 寫道： > > +1. Thanks! > >> On Thu, Oct 10, 2024 at 12:07 PM Colin McCabe wrote: >> >> +1. Thanks, Matthias. >> >> Colin >> >> >>> On Thu, Oct 10, 2024, at 08:46, Mickael Maison wrote: >>> +1, thanks for volunteering >>> >>> Mickael >>>

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #88

See

[jira] [Created] (KAFKA-17771) Local segment doesn't gets deleted when exceeding retention

Bingkun created KAFKA-17771: --- Summary: Local segment doesn't gets deleted when exceeding retention Key: KAFKA-17771 URL: https://issues.apache.org/jira/browse/KAFKA-17771 Project: Kafka Issue Type

[jira] [Resolved] (KAFKA-16658) Drop `offsets.commit.required.acks` config in 4.0 (deprecate in 3.8)

[ https://issues.apache.org/jira/browse/KAFKA-16658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-16658. - Fix Version/s: 4.0.0 Resolution: Fixed > Drop `offsets.commit.required.acks` config in 4.

[jira] [Resolved] (KAFKA-17383) Update upgrade notes about removal of `offsets.commit.required.acks`

[ https://issues.apache.org/jira/browse/KAFKA-17383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-17383. - Resolution: Fixed > Update upgrade notes about removal of `offsets.commit.required.acks` > -

[jira] [Resolved] (KAFKA-17731) Kafka consumer client sometimes elapses wait time for terminating telemetry push

[ https://issues.apache.org/jira/browse/KAFKA-17731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianet Magrans resolved KAFKA-17731. Resolution: Fixed > Kafka consumer client sometimes elapses wait time for terminating tele

Re: [DISCUSS] Apache Kafka 4.0.0 release

Hi David, The release plan looks good to me. But since the 4.0 release is a release without ZK, I'm wondering if we should list some release criteria for it? The Problem I can imagine is like, when the code freeze date is reached, but there are still many ZK removal tasks open, what should we do

Re: [DISCUSS] Apache Kafka 3.8.1 release

Hey Josep, just to update that the fix (KAFKA-17731 ) is merged into trunk now. Thanks! On Thu, Oct 10, 2024 at 4:22 AM Josep Prat wrote: > Hi Matthias, > > Yes, let's add this one to the release. I got the results from the system > tests today

Re: New release branch 3.9

Hi Colin, In Kafka 3.8 we accidentally renamed a metric: https://issues.apache.org/jira/browse/KAFKA-17749 I wonder if we should include the fix to revert it to its original name in 3.9.0 (and 3.8.1) to limit the impact: https://github.com/apache/kafka/pull/17430 Thanks, Mickael On Wed, Oct 9, 2

Re: New release branch 3.9

Hi Colin, Also, we discovered a bug affecting 3.9, that I would see as a regression given that it degrades the consumer#close. Fix has been merged to trunk with https://github.com/apache/kafka/pull/17431 so wonder if we should include it. Thanks, Lianet On Thu, Oct 10, 2024 at 9:09 AM Mickael

[jira] [Created] (KAFKA-17760) Remove client instance from cache when received telemetry terminating request

Apoorv Mittal created KAFKA-17760: - Summary: Remove client instance from cache when received telemetry terminating request Key: KAFKA-17760 URL: https://issues.apache.org/jira/browse/KAFKA-17760 Proje

[jira] [Resolved] (KAFKA-17701) KIP 919 support describeFeatures for controller

[ https://issues.apache.org/jira/browse/KAFKA-17701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TaiJuWu resolved KAFKA-17701. - Resolution: Invalid > KIP 919 support describeFeatures for controller >

[jira] [Created] (KAFKA-17761) Omit generics using type inference

xuanzhang gong created KAFKA-17761: -- Summary: Omit generics using type inference Key: KAFKA-17761 URL: https://issues.apache.org/jira/browse/KAFKA-17761 Project: Kafka Issue Type: Sub-task

Re: [DISCUSS] Apache Kafka 4.0.0 release

Hi Luke, That's a good point. I think that we should try to stick to the dates though. In my opinion, we should ensure that ZK and all the related public facing apis are gone in 4.0 by code freeze. The simplest way would be to have an epic for the removal with all the related tasks. We can then ma

Re: [DISCUSS] Apache Kafka 3.8.1 release

Hi Lianet, Will you backport it to the 3.8 branch, or shall I? Best, On Thu, Oct 10, 2024 at 3:26 PM Lianet M. wrote: > Hey Josep, just to update that the fix (KAFKA-17731 > ) is merged into trunk > now. > > Thanks! > > On Thu, Oct 10, 2024 at

Re: [DISCUSS] Apache Kafka 3.8.1 release

Done (sorry I noticed now I didn't mention I would in the previous email) Thanks! On Thu, Oct 10, 2024 at 9:41 AM Josep Prat wrote: > Hi Lianet, > > Will you backport it to the 3.8 branch, or shall I? > > Best, > > On Thu, Oct 10, 2024 at 3:26 PM Lianet M. wrote: > > > Hey Josep, just to updat

Re: [Need Help] Planning To Contribute To Kafka Open Source

Hi Anshul, Thank you for your interest in Apache Kafka! If I were you, I would not make it too complicated. The important thing is to get you started. Start with a newbie ticket as shown in this search: https://issues.apache.org/jira/issues/?filter=12347903&jql=project%20%3D%20KAFKA%20AND%20

Re: [DISCUSS] KIP-928: Making Kafka resilient to log directories becoming full

Hi Christo, Thanks for the KIP! I had some thoughts that are relevant to Kafka broker out-of-space conditions, and I'll offer them here to see if they make sense to incorporate into this KIP, or if someone suggested them before. 1. Rather than respond to an out-of-disk condition after it has hap

[DISCUSS] KIP-1096: Add ability to pass headers to ProducerPerformance.

Hi all, I would like to introduce a minor enhancement to ProducerPerformance class to pass headers to the create produce requests. KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1096 Headers are useful for tracking many aspects of the performance testing. Like regions, hosts, etc...

Re: [VOTE] KIP-1092: Extend Consumer#close with an option to leave the group or not

+1 (binding) Thanks for this KIP! On Mon, Oct 7, 2024 at 9:22 AM Kirk True wrote: > Hi TengYao, > > +1 (non-binding) > > Thanks for all the work so far on this. > > Kirk > > On Mon, Oct 7, 2024, at 4:09 AM, TengYao Chi wrote: > > Hi Andrew, > > > > Thanks for reviewing and participating in the

[jira] [Created] (KAFKA-17762) Remove Utils.isBlank

Chia-Ping Tsai created KAFKA-17762: -- Summary: Remove Utils.isBlank Key: KAFKA-17762 URL: https://issues.apache.org/jira/browse/KAFKA-17762 Project: Kafka Issue Type: Sub-task Rep

[jira] [Created] (KAFKA-17763) Remove Utils.covariantCast

Chia-Ping Tsai created KAFKA-17763: -- Summary: Remove Utils.covariantCast Key: KAFKA-17763 URL: https://issues.apache.org/jira/browse/KAFKA-17763 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-17764) Remove unnecessary ignoreable annotations from RPC schemas

Andrew Schofield created KAFKA-17764: Summary: Remove unnecessary ignoreable annotations from RPC schemas Key: KAFKA-17764 URL: https://issues.apache.org/jira/browse/KAFKA-17764 Project: Kafka

[jira] [Resolved] (KAFKA-17760) Remove client instance from cache when received telemetry terminating request

[ https://issues.apache.org/jira/browse/KAFKA-17760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17760. Resolution: Won't Fix Thanks for all discussion! > Remove client instance from cache when

Re: [DISCUSS] Apache Kafka 3.8.1 release

Hi Josep, I wonder if we should include https://issues.apache.org/jira/browse/KAFKA-17749 as well. I mentioned it in the 3.9 thread too, we accidentally renamed a metric in 3.8.0 and fixing this would limit the impact of this mistake to our users. Thanks, Mickael On Thu, Oct 10, 2024 at 4:41 PM

[jira] [Resolved] (KAFKA-17753) Update protobuf and commons-io dependencies

[ https://issues.apache.org/jira/browse/KAFKA-17753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17753. -- Fix Version/s: 4.0.0 Resolution: Fixed > Update protobuf and commons-io dependencies >

[jira] [Resolved] (KAFKA-17749) Throttle metrics have changed name

[ https://issues.apache.org/jira/browse/KAFKA-17749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-17749. -- Fix Version/s: 4.0.0 3.9.0 3.8.1 Resolution: Fixed

Re: New release branch 3.9

Hi all, I have merged KAFKA-17731 and KAFKA-17749 to 3.9. Also KAFKA-17751. We should be ready for the next RC now. Colin On Thu, Oct 10, 2024, at 08:45, Mickael Maison wrote: > Hi, > > Following up on https://issues.apache.org/jira/browse/KAFKA-17749. We > merged the fix in trunk and 3.8. > I

Re: New release branch 3.9

Hi Colin, if you haven't started probably it makes sense to merge https://github.com/apache/kafka/pull/17447 as well. Best, -- Josep Prat Open Source Engineering Director, Aiven josep.p...@aiven.io | +491715557497 | aiven.io Aiven Deutschland GmbH Alexanderufer 3-7, 10117 Berl

[jira] [Created] (KAFKA-17768) Update protobuf and commons-io dependencies in 3.7.2

Colin McCabe created KAFKA-17768: Summary: Update protobuf and commons-io dependencies in 3.7.2 Key: KAFKA-17768 URL: https://issues.apache.org/jira/browse/KAFKA-17768 Project: Kafka Issue Ty

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.7 #200

See

[jira] [Resolved] (KAFKA-17713) Ensure snapshots are aligned to batch boundaries

[ https://issues.apache.org/jira/browse/KAFKA-17713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Wu resolved KAFKA-17713. -- Resolution: Done [https://github.com/apache/kafka/pull/17398] merged. > Ensure snapshots are aligned

[jira] [Created] (KAFKA-17769) Fix flaky PlaintextConsumerSubscriptionTest.testSubscribeInvalidTopicCanUnsubscribe

Yu-Lin Chen created KAFKA-17769: --- Summary: Fix flaky PlaintextConsumerSubscriptionTest.testSubscribeInvalidTopicCanUnsubscribe Key: KAFKA-17769 URL: https://issues.apache.org/jira/browse/KAFKA-17769 Pro

[jira] [Created] (KAFKA-17770) system default Locale sensitivity in scala code uppercasing enums

Chris M. Hostetter created KAFKA-17770: -- Summary: system default Locale sensitivity in scala code uppercasing enums Key: KAFKA-17770 URL: https://issues.apache.org/jira/browse/KAFKA-17770 Project

[jira] [Created] (KAFKA-17759) Remove Utils.mkSet

Gaurav Narula created KAFKA-17759: - Summary: Remove Utils.mkSet Key: KAFKA-17759 URL: https://issues.apache.org/jira/browse/KAFKA-17759 Project: Kafka Issue Type: Sub-task Reporte

Re: [DISCUSS] Apache Kafka 3.8.1 release

Hi Matthias, Yes, let's add this one to the release. I got the results from the system tests today, and I think once we have this bug fix in, we would be good to go. Best, On Thu, Oct 10, 2024 at 12:02 AM Matthias J. Sax wrote: > Hi, > > we recently found a bug that we would like to get fixed

Re: [DISCUSS] Apache Kafka 3.7.2 release

Hi, I'd like to propose doing a 3.7.2 bug-fix release and I would volunteer to be the release manager for it. We did just fix a critical client bug for 3.8.1 and 3.9.0 and we believe that it justifies a 3.7.2 release (3.6 is not affected). If no one has any objections, I will send out a rele

Re: [DISCUSS] Apache Kafka 4.0.0 release

Hi David & Luke, We have been using https://issues.apache.org/jira/browse/KAFKA-17611 as the umbrella JIRA for ZK removal tasks. Progress has been pretty rapid, I do think we will get there by January. (Well hopefully even earlier :) best, Colin On Thu, Oct 10, 2024, at 05:55, David Jacot w

[jira] [Resolved] (KAFKA-17761) Omit generics using type inference

[ https://issues.apache.org/jira/browse/KAFKA-17761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuanzhang gong resolved KAFKA-17761. Resolution: Not A Problem > Omit generics using type inference > -

Re: [DISCUSS] Apache Kafka 3.7.2 release

+1. Thanks, Matthias. Colin On Thu, Oct 10, 2024, at 08:46, Mickael Maison wrote: > +1, thanks for volunteering > > Mickael > > On Thu, Oct 10, 2024 at 5:42 PM Bill Bejeck wrote: >> >> Thanks for volunteering Matthias! >> +1 >> >> Bill >> >> On Thu, Oct 10, 2024 at 9:39 AM Josep Prat >> wrote:

Re: [DISCUSS] Apache Kafka 3.8.1 release

Thanks! On 10/10/24 8:03 AM, Josep Prat wrote: Hi Lianet, No worries! Thanks for backporting it!! Best, On Thu, Oct 10, 2024 at 3:57 PM Lianet M. wrote: Done (sorry I noticed now I didn't mention I would in the previous email) Thanks! On Thu, Oct 10, 2024 at 9:41 AM Josep Prat wrote: H

Re: [DISCUSS] Apache Kafka 3.8.1 release

Hi Lianet, No worries! Thanks for backporting it!! Best, On Thu, Oct 10, 2024 at 3:57 PM Lianet M. wrote: > Done (sorry I noticed now I didn't mention I would in the previous email) > > Thanks! > > On Thu, Oct 10, 2024 at 9:41 AM Josep Prat > wrote: > > > Hi Lianet, > > > > Will you backport i

[jira] [Created] (KAFKA-17767) Capture tests run on trunk into test catalog

David Arthur created KAFKA-17767: Summary: Capture tests run on trunk into test catalog Key: KAFKA-17767 URL: https://issues.apache.org/jira/browse/KAFKA-17767 Project: Kafka Issue Type: Sub-

Re: [DISCUSS] Apache Kafka 4.0.0 release

Hi Colin, Thanks. That seems perfect. Does it include removing --zookeeper from the command line tools (e.g. kafka-configs)? Best, David On Thu, Oct 10, 2024 at 6:06 PM Colin McCabe wrote: > Hi David & Luke, > > We have been using https://issues.apache.org/jira/browse/KAFKA-17611 as > the umbr

[jira] [Resolved] (KAFKA-17620) Simplify share partition acquire API

[ https://issues.apache.org/jira/browse/KAFKA-17620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-17620. - Fix Version/s: 4.0.0 Resolution: Fixed merged the PR to trunk. > Simplify share partition acquir

Re: [DISCUSS] Apache Kafka 3.7.2 release

+1. Thanks! On Thu, Oct 10, 2024 at 12:07 PM Colin McCabe wrote: > +1. Thanks, Matthias. > > Colin > > > On Thu, Oct 10, 2024, at 08:46, Mickael Maison wrote: > > +1, thanks for volunteering > > > > Mickael > > > > On Thu, Oct 10, 2024 at 5:42 PM Bill Bejeck wrote: > >> > >> Thanks for voluntee

Re: [DISCUSS] Apache Kafka 4.0.0 release

Yes (although I don't believe there's a JIRA for that specifically yet.) best, Colin On Thu, Oct 10, 2024, at 09:11, David Jacot wrote: > Hi Colin, > > Thanks. That seems perfect. Does it include removing --zookeeper from the > command line tools (e.g. kafka-configs)? > > Best, > David > > On Th

[jira] [Created] (KAFKA-17765) Remove TestUtils.toSet

Chia-Ping Tsai created KAFKA-17765: -- Summary: Remove TestUtils.toSet Key: KAFKA-17765 URL: https://issues.apache.org/jira/browse/KAFKA-17765 Project: Kafka Issue Type: Sub-task R

[jira] [Created] (KAFKA-17766) TopicBasedRemoteLogMetadataManager stuck in close

David Arthur created KAFKA-17766: Summary: TopicBasedRemoteLogMetadataManager stuck in close Key: KAFKA-17766 URL: https://issues.apache.org/jira/browse/KAFKA-17766 Project: Kafka Issue Type:

Re: [DISCUSS] Apache Kafka 3.8.1 release

Hi Mickael, Yes, I was about to ask on the other thread if we should also do it for 3.8. Let's do it, let's have it in 3.8 as well. I commented in the PR, I think for 3.8 at least, we should mention this in the `upgrade.html` page so users are aware of it. For 3.9, if we manage to get it in 3.9.0

Re: [DISCUSS] Apache Kafka 3.7.2 release

Thanks for volunteering Matthias! +1 Bill On Thu, Oct 10, 2024 at 9:39 AM Josep Prat wrote: > Hi Matthias, > > +1 thanks for volunteering! > > Best, > > On Thu, Oct 10, 2024 at 5:36 PM Matthias J. Sax wrote: > > > Hi, > > > > I'd like to propose doing a 3.7.2 bug-fix release and I would volunt

Re: [DISCUSS] Apache Kafka 3.7.2 release

Hi Matthias, +1 thanks for volunteering! Best, On Thu, Oct 10, 2024 at 5:36 PM Matthias J. Sax wrote: > Hi, > > I'd like to propose doing a 3.7.2 bug-fix release and I would volunteer > to be the release manager for it. We did just fix a critical client bug > for 3.8.1 and 3.9.0 and we believe

Re: New release branch 3.9

Hi, Following up on https://issues.apache.org/jira/browse/KAFKA-17749. We merged the fix in trunk and 3.8. I opened a PR for 3.9: https://github.com/apache/kafka/pull/17457 Thanks, Mickael On Thu, Oct 10, 2024 at 3:14 PM Lianet M. wrote: > > Hi Colin, > > Also, we discovered a bug affecting 3.9

Re: [DISCUSS] Apache Kafka 3.7.2 release

+1, thanks for volunteering Mickael On Thu, Oct 10, 2024 at 5:42 PM Bill Bejeck wrote: > > Thanks for volunteering Matthias! > +1 > > Bill > > On Thu, Oct 10, 2024 at 9:39 AM Josep Prat > wrote: > > > Hi Matthias, > > > > +1 thanks for volunteering! > > > > Best, > > > > On Thu, Oct 10, 2024 at

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #87

See

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #86

See

[VOTE] 3.9.0 RC2

This is the second candidate for the release of Apache Kafka 3.9.0. I have titled it rc2 since I had an rc1 which got very far, even to the point of pushing tags and docker images, before I spotted an issue. So rather than mutate the tags, I decided to skip over rc1. - This is a major release,

Re: [VOTE] 3.9.0 RC2

I also wanted to note that 3.9.0-RC2 doesn't include David's fix for KAFKA-17193. Since that PR only affects our integration with Github Actions and not the Java or Scala source code of Kafka, I did not re-generate the release candidate tar.gz and/or tags after that fix was made. Also, thanks D