[jira] [Created] (KAFKA-19170) Migrate MetricsDuringTopicCreationDeletionTest to clients-integration-tests module

2025-04-17 Thread Chia-Ping Tsai (Jira)
Chia-Ping Tsai created KAFKA-19170: -- Summary: Migrate MetricsDuringTopicCreationDeletionTest to clients-integration-tests module Key: KAFKA-19170 URL: https://issues.apache.org/jira/browse/KAFKA-19170

[jira] [Created] (KAFKA-19171) Kafka Streams crashes with UnsupportedOperationException

2025-04-17 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-19171: --- Summary: Kafka Streams crashes with UnsupportedOperationException Key: KAFKA-19171 URL: https://issues.apache.org/jira/browse/KAFKA-19171 Project: Kafka

Re: [DISCUSS] KIP-1140: Avoid to return null value in Map from public api of consumer

2025-04-17 Thread Kirk True
Hi Chia-Ping, An "enable unreleased behavior" flag is an interesting idea; basically a feature flag. The main benefit (coarsely grained) is also its biggest weakness. I'm not really sure the target audience that would enable it. Thanks, Kirk On Mon, Apr 14, 2025, at 9:39 PM, Chia-Ping Tsai wro

Re: read cluster metadata topic

2025-04-17 Thread Péter Sinóros-Szabó
Hi Chia-Ping, > Pardon me, what is the purpose of monitoring __cluster_metadata? We run one of our Kafka clusters on Kubernetes, where the IP address of the pods running the broker changes every time the pod is restarted for any reason. So we need to see as brokers are stopped and restarted, so th

Re: [DISCUSS] Apache Kafka 4.1.0 release

2025-04-17 Thread Ismael Juma
Awesome, thanks. Ismael On Thu, Apr 17, 2025, 12:10 AM Mickael Maison wrote: > Hi, > > I updated the release plan and moved all dates forward by 2 weeks. > > Thanks, > Mickael > > On Thu, Apr 17, 2025 at 3:19 AM Matthias J. Sax wrote: > > > > I would want to backup the idea to move the release

Re: read cluster metadata topic

2025-04-17 Thread José Armando García Sancio
Hi Peter, On Thu, Apr 17, 2025 at 2:44 PM Péter Sinóros-Szabó wrote: > So we need to see as brokers are stopped and restarted, so that we > get it's new IP and can update it on our service mesh configuration. Very interesting use case. First, the data stored in the __cluster_metadata-0 partition

[jira] [Resolved] (KAFKA-17897) Deprecate Admin.listConsumerGroups

2025-04-17 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-17897. Resolution: Fixed > Deprecate Admin.listConsumerGroups > -

[jira] [Created] (KAFKA-19172) Handle the evictions metric in ShareSessionCache

2025-04-17 Thread Chirag Wadhwa (Jira)
Chirag Wadhwa created KAFKA-19172: - Summary: Handle the evictions metric in ShareSessionCache Key: KAFKA-19172 URL: https://issues.apache.org/jira/browse/KAFKA-19172 Project: Kafka Issue Type

Re: [DISCUSS] KIP-1101: Trigger rebalance on rack topology changes

2025-04-17 Thread David Jacot
Thanks, PoAn! On Thu, Apr 17, 2025 at 8:59 AM PoAn Yang wrote: > Hi David, > > Thanks for the review. Appreciated it. > > DJ05: Let's discuss more in the pull request. > > DJ07: Add section “Bump Group Version” to “Rejected Alternatives”. > > Thanks, > PoAn > > > On Apr 16, 2025, at 4:34 PM, Dav

Re: [DISCUSS] Apache Kafka 4.1.0 release

2025-04-17 Thread Mickael Maison
Hi, I updated the release plan and moved all dates forward by 2 weeks. Thanks, Mickael On Thu, Apr 17, 2025 at 3:19 AM Matthias J. Sax wrote: > > I would want to backup the idea to move the release earlier if possible. > Looking into historic release dates, we are slipping by roughly two > week

Re: [VOTE] KIP-1101: Trigger rebalance on rack topology changes

2025-04-17 Thread PoAn Yang
Hi all, Thanks for your voting and participation. The KIP-1101 has been accepted with 5 binding +1 from Chia-Ping Tsai, Lucas Brutschy, Andrew Schofield, David Jacot, and TengYao Chi. Also, getting 2 non-binding +1 from TaiJu Wu and 郭骏旺. Thanks for everyone. Regards, PoAn > On Apr 17, 2025, a

Re: [PR] Added missing `/migration` znode deletion on rollback KRaft migration [kafka-site]

2025-04-17 Thread via GitHub
ppatierno commented on PR #684: URL: https://github.com/apache/kafka-site/pull/684#issuecomment-2814690866 @fvaleri it's not "just" a note, it's a clear statement of what it's needed to do. If you see, the same statement is present in the previous phase/line and in the same column. -- Th

Re: [DISCUSS] KIP-1140: Avoid to return null value in Map from public api of consumer

2025-04-17 Thread Kirk True
Hi Colin, If so, is 5.0 the earliest this 'allow.nulls.in.consumer' configuration can be changed and marked as deprecated? And if that holds, is 6.0 the earliest it can be removed? Thanks, Kirk On Mon, Apr 14, 2025, at 1:10 PM, Colin McCabe wrote: > I would suggest adding a configuration key w

Message format compatibility during/after upgrade

2025-04-17 Thread Atul Sharma
Hi Team, Regarding the Kafka cluster upgrade from VersionA to VersionB, I have a query about message format compatibility. Let's assume we have a topic "topicA" containing messages written with the message log format version "v1-a". After the Kafka cluster migration is complete and the broker's l

read cluster metadata topic

2025-04-17 Thread Péter Sinóros-Szabó
Hi, I'm looking for a way to consume the cluster metadata updates when using KRaft. I thought I'll just consume the __cluster_metadata topic, but as I see that's not possible, at least I didn't manage to do that with the console consumer. I know we have the dump tool or the metadata shell to quer

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-17 Thread pritam kumar
Hi Sudesh, Sorry for the earlier comment, I just checked that avro in 1.12 has timestamp-nanos support. I will update the KIP to have nanosecond support also and correspondingly I will make changes for nanosecond. Thanks Pritam. On Wed, Apr 16, 2025 at 7:13 PM pritam kumar wrote: > Also just to

Re: read cluster metadata topic

2025-04-17 Thread Chia-Ping Tsai
hi Peter Pardon me, what is the purpose of monitoring __cluster_metadata? Are you looking to observe topic changes or other cluster modifications? As brokers continuously send heartbeat requests, __cluster_metadata will keep "updating" even if there are no topic changes. Best, Chia-Ping Péter S

Re: [DISCUSS] KIP-1140: Avoid to return null value in Map from public api of consumer

2025-04-17 Thread Chia-Ping Tsai
hi Kirk “coarsely grained” is a good point. We need to list all behaviors impacted by the config - no matter which new config we adopted. Maybe we can add the flag to xxxOption? The benefit is users can explicitly see “which” APIs are impacted. The downside is the number of deprecated methods i

[jira] [Created] (KAFKA-19173) Add `Feature` for streams groups

2025-04-17 Thread Matthias J. Sax (Jira)
Matthias J. Sax created KAFKA-19173: --- Summary: Add `Feature` for streams groups Key: KAFKA-19173 URL: https://issues.apache.org/jira/browse/KAFKA-19173 Project: Kafka Issue Type: Sub-task

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-17 Thread pritam kumar
Thank you Sudesh, for reviewing the KIP and the valuable feedback. Thanks, Pritam On Thu, Apr 17, 2025 at 8:59 PM Sudesh Wasnik wrote: > Thanks Pritam! > No more feedback from my end. Nice addition ! > > Thanks, > Sudesh > On 17 Apr 2025 at 4:59 PM +0530, pritam kumar , > wrote: > > I have made

[jira] [Resolved] (KAFKA-19136) Move metadata-related configs from KRaftConfigs to MetadataLogConfig

2025-04-17 Thread Chia-Ping Tsai (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19136. Fix Version/s: 4.1.0 Resolution: Fixed > Move metadata-related configs from KRaftCo

Re: [DISCUSS] Apache Kafka 4.1.0 release

2025-04-17 Thread Matthias J. Sax
Thanks! I am wondering if we should set more or less "fixed" dates (or date ranges) for future release? To keep a real "time based" release schedule and give some guidance? Thoughts? -Matthias On 4/17/25 11:55 AM, Ismael Juma wrote: Awesome, thanks. Ismael On Thu, Apr 17, 2025, 12:10 A

Re: [DISCUSS] KIP-1101: Trigger rebalance on rack topology changes

2025-04-17 Thread PoAn Yang
Hi David, Thanks for the review. Appreciated it. DJ05: Let's discuss more in the pull request. DJ07: Add section “Bump Group Version” to “Rejected Alternatives”. Thanks, PoAn > On Apr 16, 2025, at 4:34 PM, David Jacot wrote: > > Hi PoAn, > > Thanks for your very detailed answers! > > DJ05:

[jira] [Created] (KAFKA-19168) MirrorMaker kafka_metrics_count metric is always incorrect

2025-04-17 Thread Mickael Maison (Jira)
Mickael Maison created KAFKA-19168: -- Summary: MirrorMaker kafka_metrics_count metric is always incorrect Key: KAFKA-19168 URL: https://issues.apache.org/jira/browse/KAFKA-19168 Project: Kafka

[jira] [Resolved] (KAFKA-19024) Enhance the client behaviour when it tries to exceed the `group.share.max.groups`

2025-04-17 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19024. -- Resolution: Won't Fix The `group.share.max.groups` configuration was removed so this i

[jira] [Reopened] (KAFKA-19024) Enhance the client behaviour when it tries to exceed the `group.share.max.groups`

2025-04-17 Thread Andrew Schofield (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-19024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield reopened KAFKA-19024: -- Assignee: Andrew Schofield (was: Lan Ding) Reopened to update the Resolution field.

[jira] [Resolved] (KAFKA-14523) Move RemoteLogManager to the storage module

2025-04-17 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-14523. Fix Version/s: 4.1.0 Resolution: Fixed > Move RemoteLogManager to the storage modul

[jira] [Created] (KAFKA-19169) Enhance AuthorizerIntegrationTest for share group APIs

2025-04-17 Thread Andrew Schofield (Jira)
Andrew Schofield created KAFKA-19169: Summary: Enhance AuthorizerIntegrationTest for share group APIs Key: KAFKA-19169 URL: https://issues.apache.org/jira/browse/KAFKA-19169 Project: Kafka

Re: Kafka tags on repo

2025-04-17 Thread Jamie Mark Goodyear
Thank you for looking into this. The fetch --tags worked for checking out the 4.0.0 tag from git. Cheers, Jamie On 2025/04/17 01:25:58 David Arthur wrote: > Matthias pointed out to me that there are indeed some orphaned tags for > recent releases. This appears to be a bug in our release script

Re: Re: [DISCUSS] KIP-1153: Extending support for Microsecond Precision for Kafka Connect

2025-04-17 Thread pritam kumar
I have made Nanosecond related changes in the KIP. Please have a look. Thanks Pritam. On Thu, Apr 17, 2025 at 4:25 PM pritam kumar wrote: > Hi Sudesh, > Sorry for the earlier comment, I just checked that avro in 1.12 has > timestamp-nanos support. I will update the KIP to have nanosecond support

Re: [DISCUSS] KIP-1150 Diskless Topics

2025-04-17 Thread Luke Chen
Hi Josep, Thanks for the KIP! Quite exciting to see this feature brought into Apache Kafka Comments: 1. "Permit multi-region active-active topics with automatic failover" I didn't see any future work mentioning this. Does it mean, with diskless topic MVP, this will work by default? 2. "Write

Re: Request to contribute to Apache Kafka

2025-04-17 Thread Matthias J. Sax
You should be all set. On 4/16/25 2:08 AM, Giuseppe Lillo wrote: Hello, I would like to contribute to the Apache Kafka project. Wiki ID: giuseppelilloaiven Jira ID: giuseppelilloaiven Thank you Giuseppe Lillo