[jira] [Resolved] (KAFKA-19147) ConsumerGroupHeartbeat API leaks topic id and partition count of unauthorized topics

2025-04-16 Thread Rajini Sivaram (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-19147. Fix Version/s: 4.1.0 Reviewer: David Jacot Resolution: Fixed > ConsumerGro

Custom Kafka Connect REST Extension for Token Authentication

2025-04-16 Thread Jamie
Hi All,  I'm trying to implement a custom REST extension for Kafka Connect that allows a token to be used for authentication.  When I have a single instance of Kafka connect running in distributed mode (i.e. 1 worker) this works as expected. However, when I add another instance (another worker)

[jira] [Created] (KAFKA-19166) Release tags are orphaned

2025-04-16 Thread David Arthur (Jira)
David Arthur created KAFKA-19166: Summary: Release tags are orphaned Key: KAFKA-19166 URL: https://issues.apache.org/jira/browse/KAFKA-19166 Project: Kafka Issue Type: Bug Reporte

Re: [VOTE] 3.9.1 RC0

2025-04-16 Thread Matthias J. Sax
Thanks for cutting the first RC. I just want to point to the email on the dev list with subject: `Kafka tags on repo`. It seems, our release scripts have some issue. David Arthur is actively investigation: https://issues.apache.org/jira/browse/KAFKA-19166 Apparently something is not pushed

Re: Kafka tags on repo

2025-04-16 Thread David Arthur
Matthias pointed out to me that there are indeed some orphaned tags for recent releases. This appears to be a bug in our release script or release process. I've filed https://issues.apache.org/jira/browse/KAFKA-19166 to track the issue. We'll get this sorted out promptly. -David On Tue, Apr 15,

Re: [VOTE] KIP-1101: Trigger rebalance on rack topology changes

2025-04-16 Thread Lucas Brutschy
+1 (binding) On Tue, Dec 17, 2024 at 2:08 AM 郭骏旺 wrote: > > +1 (non-binding) > > On Mon, Dec 16, 2024 at 5:01 PM PoAn Yang wrote: > > > Hi All, > > > > I would like to start vote on KIP-1101: > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-1101%3A+Trigger+rebalance+on+rack+topology

[jira] [Created] (KAFKA-19162) Topology description sent to broker contains non-determinstically ordered topic configs

2025-04-16 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19162: -- Summary: Topology description sent to broker contains non-determinstically ordered topic configs Key: KAFKA-19162 URL: https://issues.apache.org/jira/browse/KAFKA-19162

Re: [VOTE] KIP-1101: Trigger rebalance on rack topology changes

2025-04-16 Thread David Jacot
+1 (binding). Thanks for the KIP! David On Wed, Apr 16, 2025 at 6:19 PM Andrew Schofield wrote: > > +1 (binding) > > Thanks, > Andrew > > From: Lucas Brutschy > Sent: 16 April 2025 08:17 > To: dev@kafka.apache.org > Subject: Re: [VOTE] KIP-1101: Trigger

[jira] [Resolved] (KAFKA-19158) Add a new error code for “share session limit reached”

2025-04-16 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19158. -- Fix Version/s: 4.1.0 Resolution: Fixed > Add a new error code for “share sessio

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-16 Thread pritam kumar
Also just to add I did not add this in the first place as I think Avro itself does not have the Nanosecond logical type. On Wed, Apr 16, 2025 at 7:01 PM pritam kumar wrote: > Thanks Sudesh, for taking a look at this. I am already working on > extending this for nanosecond precision as most sinks

Re: [DISCUSS] Apache Kafka 4.1.0 release

2025-04-16 Thread Ismael Juma
The issue is that July 23rd is the "earliest release date" but historically the actual release is weeks after that date from the release plan. So, a code freeze of June 25th would probably give us a better chance of hitting the 4 months goal. Would that work for you? Thanks, Ismael On Wed, Apr 16

Re: [VOTE] KIP-1101: Trigger rebalance on rack topology changes

2025-04-16 Thread Andrew Schofield
+1 (binding) Thanks, Andrew From: Lucas Brutschy Sent: 16 April 2025 08:17 To: dev@kafka.apache.org Subject: Re: [VOTE] KIP-1101: Trigger rebalance on rack topology changes +1 (binding) On Tue, Dec 17, 2024 at 2:08 AM 郭骏旺 wrote: > > +1 (non-binding) >

[PR] Added missing `/migration` znode deletion on rollback KRaft migration [kafka-site]

2025-04-16 Thread via GitHub
ppatierno opened a new pull request, #684: URL: https://github.com/apache/kafka-site/pull/684 The table provided in the section "Reverting to ZooKeeper mode During the Migration" of the KRaft migration guide is written in a way that each line is self-consistent (or this is my understanding)

Re: [PR] Added missing `/migration` znode deletion on rollback KRaft migration [kafka-site]

2025-04-16 Thread via GitHub
ppatierno commented on PR #684: URL: https://github.com/apache/kafka-site/pull/684#issuecomment-2810142898 @mimaison can you take a look at this one please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [DISCUSS] Apache Kafka 4.1.0 release

2025-04-16 Thread Mickael Maison
Hi Ismael, Sorry I had written the reply but never hit "send". France has a public holiday on July 14, so I thought I may be out some days that week. To be safe, I picked the week after as I thought July 23 was close enough to mid July. That said I currently don't have anything planned, so I can

[jira] [Created] (KAFKA-19163) New group coordinator can incorrectly delete groups with pending transactional offsets

2025-04-16 Thread Sean Quah (Jira)
Sean Quah created KAFKA-19163: - Summary: New group coordinator can incorrectly delete groups with pending transactional offsets Key: KAFKA-19163 URL: https://issues.apache.org/jira/browse/KAFKA-19163 Proj

[jira] [Created] (KAFKA-19164) New group coordinator won't delete groups with previously pending transactional offsets that were deleted

2025-04-16 Thread Sean Quah (Jira)
Sean Quah created KAFKA-19164: - Summary: New group coordinator won't delete groups with previously pending transactional offsets that were deleted Key: KAFKA-19164 URL: https://issues.apache.org/jira/browse/KAFKA-1916

[jira] [Created] (KAFKA-19165) PartitionLeaderStrategy has very high error rate during topic initialization

2025-04-16 Thread Steven Schlansker (Jira)
Steven Schlansker created KAFKA-19165: - Summary: PartitionLeaderStrategy has very high error rate during topic initialization Key: KAFKA-19165 URL: https://issues.apache.org/jira/browse/KAFKA-19165

Re: Kafka tags on repo

2025-04-16 Thread Luke Chen
Thank you, David! Luke On Thu, Apr 17, 2025 at 9:26 AM David Arthur wrote: > Matthias pointed out to me that there are indeed some orphaned tags for > recent releases. This appears to be a bug in our release script or release > process. I've filed https://issues.apache.org/jira/browse/KAFKA-191

[jira] [Resolved] (KAFKA-19024) Enhance the client behaviour when it tries to exceed the `group.share.max.groups`

2025-04-16 Thread Lan Ding (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lan Ding resolved KAFKA-19024. -- Resolution: Fixed > Enhance the client behaviour when it tries to exceed the > `group.share.max.group

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #270

2025-04-16 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-19167) Move RemoteLogManagerConfig out of KafkaConfig

2025-04-16 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-19167: -- Summary: Move RemoteLogManagerConfig out of KafkaConfig Key: KAFKA-19167 URL: https://issues.apache.org/jira/browse/KAFKA-19167 Project: Kafka Issue Type

[jira] [Resolved] (KAFKA-19054) StreamThread exception handling with SHUTDOWN_APPLICATION may trigger a tight loop with MANY logs

2025-04-16 Thread Matthias J. Sax (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-19054. - Fix Version/s: 4.1.0 4.0.1 Resolution: Fixed > StreamThread ex

[jira] [Resolved] (KAFKA-19151) Enhance the docs of flush.ms by reminding users the flush is triggered by log.flush.scheduler.interval.ms

2025-04-16 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19151. Fix Version/s: 4.1.0 Resolution: Fixed > Enhance the docs of flush.ms by reminding

Re: [DISCUSS] Apache Kafka 4.1.0 release

2025-04-16 Thread Matthias J. Sax
I would want to backup the idea to move the release earlier if possible. Looking into historic release dates, we are slipping by roughly two weeks year over year, and I think it would be good to work against it. 4.0.0: March/18 2025 3.7.0: Feb/27 2024 3.4.0: Feb/7 2023 3.1.0: Jan/24 2022 It's

Kafka upgrade guide from 2.8.2 to 3.5.1

2025-04-16 Thread Kartik Dev
Hi team, I have two queries regarding the upgrade path mentioned in the link: https://kafka.apache.org/35/documentation.html#upgrade 1. I want to upgrade my kafka cluster from 2.8.2 to 3.5.1. My 2.8.2 cluster is running on JDK 8 So the new kafka 3.5.1 cluster is required to be on JDK 8 or while s

Re: [DISCUSS] KIP-1101: Trigger rebalance on rack topology changes

2025-04-16 Thread David Jacot
Hi PoAn, Thanks for your very detailed answers! DJ05: This seems reasonable. We can look into it more deeply during the implementation too. DJ07: Yeah, I see your point. I don't have a strict opinion on this so I am happy to go with the majority. Could you please at least mention in the rejected

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #191

2025-04-16 Thread Apache Jenkins Server
See

RE: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-16 Thread Sudesh Wasnik
Hi Pritam ! Thanks for the KIP ! Let’s extend the KIP to also add support for Nanosecond precision! Thanks Sudesh On 2025/04/05 01:30:49 pritam kumar wrote: > Hi Kafka Community, > Sorry due to some changes I had to change the link to the kip. > Here is the updated KIP link: > https://cwiki.apach

[jira] [Created] (KAFKA-19160) Fetching stable offsets is very slow with a large number of partition and open transactions

2025-04-16 Thread Sean Quah (Jira)
Sean Quah created KAFKA-19160: - Summary: Fetching stable offsets is very slow with a large number of partition and open transactions Key: KAFKA-19160 URL: https://issues.apache.org/jira/browse/KAFKA-19160

[DISCUSS] KIP-1150 Diskless Topics

2025-04-16 Thread Josep Prat
Hi Kafka Devs! We want to start a new KIP discussion about introducing a new type of topics that would make use of Object Storage as the primary source of storage. However, as this KIP is big we decided to split it into multiple related KIPs. We have the motivational KIP-1150 ( https://cwiki.apach

[jira] [Created] (KAFKA-19161) Diskless Topics

2025-04-16 Thread Ivan Yurchenko (Jira)
Ivan Yurchenko created KAFKA-19161: -- Summary: Diskless Topics Key: KAFKA-19161 URL: https://issues.apache.org/jira/browse/KAFKA-19161 Project: Kafka Issue Type: New Feature Compone

[jira] [Created] (KAFKA-19156) Remove group.share.max.groups config

2025-04-16 Thread Chirag Wadhwa (Jira)
Chirag Wadhwa created KAFKA-19156: - Summary: Remove group.share.max.groups config Key: KAFKA-19156 URL: https://issues.apache.org/jira/browse/KAFKA-19156 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-19115) Utilize initialized topics info to verify delete share group offsets

2025-04-16 Thread Chirag Wadhwa (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chirag Wadhwa resolved KAFKA-19115. --- Resolution: Fixed > Utilize initialized topics info to verify delete share group offsets > -

[jira] [Created] (KAFKA-19158) Add a new error code for “share session not created”

2025-04-16 Thread Chirag Wadhwa (Jira)
Chirag Wadhwa created KAFKA-19158: - Summary: Add a new error code for “share session not created” Key: KAFKA-19158 URL: https://issues.apache.org/jira/browse/KAFKA-19158 Project: Kafka Issue

[jira] [Created] (KAFKA-19157) Add group.share.max.share.session.cache.slots config

2025-04-16 Thread Chirag Wadhwa (Jira)
Chirag Wadhwa created KAFKA-19157: - Summary: Add group.share.max.share.session.cache.slots config Key: KAFKA-19157 URL: https://issues.apache.org/jira/browse/KAFKA-19157 Project: Kafka Issue

[jira] [Created] (KAFKA-19159) Remove time based eviction of share sessions from the cache

2025-04-16 Thread Chirag Wadhwa (Jira)
Chirag Wadhwa created KAFKA-19159: - Summary: Remove time based eviction of share sessions from the cache Key: KAFKA-19159 URL: https://issues.apache.org/jira/browse/KAFKA-19159 Project: Kafka

[jira] [Created] (KAFKA-19155) Update docs/security.html for streams-related RPCs

2025-04-16 Thread Lucas Brutschy (Jira)
Lucas Brutschy created KAFKA-19155: -- Summary: Update docs/security.html for streams-related RPCs Key: KAFKA-19155 URL: https://issues.apache.org/jira/browse/KAFKA-19155 Project: Kafka Issue

[VOTE] 3.9.1 RC0

2025-04-16 Thread TengYao Chi
Hello Kafka users, developers, and client-developers, This is the first candidate for the release of Apache Kafka 3.9.1. This is a bug-fix release with several fixes, and most importantly, it adds Java 23 support for 3.9 Release notes for the 3.9.1 release: https://dist.apache.org/repos/dist/dev

Request to contribute to Apache Kafka

2025-04-16 Thread Giuseppe Lillo
Hello, I would like to contribute to the Apache Kafka project. Wiki ID: giuseppelilloaiven Jira ID: giuseppelilloaiven Thank you Giuseppe Lillo

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-16 Thread pritam kumar
Thanks Sudesh, for taking a look at this. I am already working on extending this for nanosecond precision as most sinks like iceberg have started giving nanosecond precision options. On Wed, Apr 16, 2025 at 4:41 PM Sudesh Wasnik wrote: > Hi Pritam ! Thanks for the KIP ! > Let’s extend the KIP to

[jira] [Resolved] (KAFKA-19002) Rewrite ListOffsetsIntegrationTest and move it to clients-integration-test

2025-04-16 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19002. Fix Version/s: 4.1.0 Resolution: Fixed > Rewrite ListOffsetsIntegrationTest and mov

Re: [PR] Added missing `/migration` znode deletion on rollback KRaft migration [kafka-site]

2025-04-16 Thread via GitHub
cmccabe commented on PR #684: URL: https://github.com/apache/kafka-site/pull/684#issuecomment-2810718582 @mumrah @mimaison @ppatierno the states are in the wrong order here. Fix here : https://github.com/apache/kafka/pull/19499 -- This is an automated message from the Apache Git Service.

Re: Kafka upgrade guide from 2.8.2 to 3.5.1

2025-04-16 Thread Colin McCabe
On Wed, Apr 16, 2025, at 02:23, Kartik Dev wrote: > Hi team, > > I have two queries regarding the upgrade path mentioned in the link: > https://kafka.apache.org/35/documentation.html#upgrade > > 1. I want to upgrade my kafka cluster from 2.8.2 to 3.5.1. My 2.8.2 cluster > is running on JDK 8 > So