[jira] [Created] (KAFKA-19096) Skipped Records in FK join should not be marked as dropped

Ayoub Omari created KAFKA-19096: --- Summary: Skipped Records in FK join should not be marked as dropped Key: KAFKA-19096 URL: https://issues.apache.org/jira/browse/KAFKA-19096 Project: Kafka Issu

[jira] [Resolved] (KAFKA-19017) Change consumer-config to command-config in verifiable_share_consumer.py

[ https://issues.apache.org/jira/browse/KAFKA-19017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19017. -- Resolution: Fixed > Change consumer-config to command-config in verifiable_share_consu

[jira] [Resolved] (KAFKA-18940) Fix uncleanLeaderElection metric due to ELR election

[ https://issues.apache.org/jira/browse/KAFKA-18940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Calvin Liu resolved KAFKA-18940. Resolution: Fixed > Fix uncleanLeaderElection metric due to ELR election > ---

Re: [PR] Update powered-by.html [kafka-site]

varunprakashnkl commented on PR #676: URL: https://github.com/apache/kafka-site/pull/676#issuecomment-2740902641 Hi, #676 is the file content and #677 is the logo to upload in powered by folder -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [ANNOUNCE] Apache Kafka 4.0.0

Thanks David for running this release!! -- Kamal On Tue, Mar 18, 2025 at 11:33 PM Justine Olshan wrote: > Yay! I'm happy to see this release. > > Thanks David for your hard work as well as everyone else in the community > who rallied to get this over the line! > > Justine > > On Tue, Mar 18, 20

Re: [ANNOUNCE] Apache Kafka 4.0.0

Yay! I'm happy to see this release. Thanks David for your hard work as well as everyone else in the community who rallied to get this over the line! Justine On Tue, Mar 18, 2025 at 10:00 AM Apoorv Mittal wrote: > Congratulations! > > A new milestone for Apache Kafka, thanks David for running t

Re: [DISCUSS] KIP-1142: Allow to list non-existent group which has dynamic config

Hi all, If there is no further discussion, I will start vote thread for KIP-1142 tomorrow. Thanks, PoAn > On Mar 16, 2025, at 5:23 PM, PoAn Yang wrote: > > Hi Andrew, > > Thanks for the review. > > AS1: The kafka-client-metrics.sh —describe —name for a non-existent > client-metric shows de

Re: KIP-1141: Simplifying MetadataQuorumCommand by Leveraging Admin API for Controller Management

hi Jose > I am not sure. I have to look at that code but doesn't "Admin#describeConfigs" only return dynamic configuration for the controller? Most users configure the controller using the server properties file. My current understanding is that values coming from the properties file won't show up

[jira] [Resolved] (KAFKA-18989) Optimize FileRecord#searchForOffsetWithSize

[ https://issues.apache.org/jira/browse/KAFKA-18989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18989. Fix Version/s: 4.1.0 Resolution: Fixed > Optimize FileRecord#searchForOffsetWithSiz

[jira] [Created] (KAFKA-19074) Remove the cached responseData from ShareFetchResponse

Chia-Ping Tsai created KAFKA-19074: -- Summary: Remove the cached responseData from ShareFetchResponse Key: KAFKA-19074 URL: https://issues.apache.org/jira/browse/KAFKA-19074 Project: Kafka Is

[PR] Fixed znode deletion command [kafka-site]

ppatierno opened a new pull request, #679: URL: https://github.com/apache/kafka-site/pull/679 The ZooKeeper CLI has the `rmr` command to delete znodes but the `zookeeper-shell` script provides the `delete` one. This PR fixes the documentation related to KRaft migration rollback by replac

[jira] [Resolved] (KAFKA-18946) Move BrokerReconfigurable and DynamicProducerStateManagerConfig to server module

[ https://issues.apache.org/jira/browse/KAFKA-18946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18946. Fix Version/s: 4.1.0 Resolution: Fixed > Move BrokerReconfigurable and DynamicProdu

Re: [kafka-clients] [ANNOUNCE] Apache Kafka 4.0.0

Thank you, David! Well done! Best, Bruno On 18.03.25 16:43, David Jacot wrote: The Apache Kafka community is pleased to announce the release for Apache Kafka 4.0.0 - This is the first release without Apache Zookeeper - The Next Generation of the Consumer Rebalance Protocol is Generally Availab

RE: kafka 4.0.0 running on java 11

Hi, Will there be a backdated version? If we are unable to upgrade to java 17? Thanks a lot! Regards, Max Sensitivity Label: General -Original Message- From: PoAn Yang Sent: Wednesday, 2 April 2025 2:17 pm To: dev@kafka.apache.org Subject: Re: kafka 4.0.0 running on java 11 Hi Max,

[jira] [Created] (KAFKA-19022) Display cluster IDs being compared when encountering INCONSISTENT_CLUSTER_ID error

Ranganath Samudrala created KAFKA-19022: --- Summary: Display cluster IDs being compared when encountering INCONSISTENT_CLUSTER_ID error Key: KAFKA-19022 URL: https://issues.apache.org/jira/browse/KAFKA-19022

Re: [VOTE] KIP-1064 - Upgrade slf4j to 2.x

hi Teng > The KIP will document that log4j2 is the only officially supported server-side logging framework, and we will expose its configuration file to users. on the server-side, we should keep current scope - compileOnly and releaseOnly - Otherwise, downstream projects could encounter dep

Re: [DISCUSS] KIP-1152: Add transactional ID prefix filter to ListTransactions API

hi Calvin thanks for filing this KIP. Some questions are listed below. PTAL chia_0: could you please add discussion link to the KIP? chia_1: Have you consider using regex or multi-prefixes (similar to ProducerIdFilters) instead of prefix? it seems to be more flexible. Best, Chia-Ping Calvin

Re: [DISCUSS] KIP-1138: Clean up TopologyConfig and API for supplying configs needed by the topology

This was nagging at me so I dug around and managed to find the original discussion around needing StreamsConfig for dependency injection: https://github.com/apache/kafka/pull/5344 tl;dr the StreamsConfig overloads aren't doing anything useful on their own, we definitely shouldn't use StreamsConfig

Re: [DISCUSS] Git commits and metadata

hi David +100 to this change. > signed-off-by I guess this is used to log the guy who does commit the PR? > Helped-by Is it equal to Co-authored-by? > Fixes: KAFKA-12345 We will log the jira in the commit title, so maybe we don't need to lo

[jira] [Created] (KAFKA-19067) AsyncKafkaConsumer may return stale fetch result after seek operation

PoAn Yang created KAFKA-19067: - Summary: AsyncKafkaConsumer may return stale fetch result after seek operation Key: KAFKA-19067 URL: https://issues.apache.org/jira/browse/KAFKA-19067 Project: Kafka

Re: [VOTE] KIP-1064 - Upgrade slf4j to 2.x

hi Ismael > but they must also add whichever logging library they want to use. If users are required to modify JAR files to alter the SLF4J provider, the value of this KIP is significantly diminished. I believe the primary benefit of this KIP lies in enabling users to configure a system property

[jira] [Resolved] (KAFKA-18680) Design unclean recovery elections subsystem

[ https://issues.apache.org/jira/browse/KAFKA-18680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonah Hooper resolved KAFKA-18680. -- Resolution: Fixed Created a design for this and started the initial implementation.  > Design

Re: KIP-1141: Simplifying MetadataQuorumCommand by Leveraging Admin API for Controller Management

hi Jose Thanks for sharing. I have a question. > To my knowledge this information is not available to the Admin client. We propose to use `Admin#describeConfigs` to get the configs for specific controller if the bootstrap.controllers is configured. This approach is similar to what `MetadataQuo

Re: [VOTE] KIP-1133: AK Documentation and Website in Markdown

Thanks for this KIP, +1 (non-binding) Best Regards, Jiunn-Yang > Kirk True 於 2025年4月4日 凌晨1:21 寫道： > > +1 (non-binding) > > On Thu, Apr 3, 2025, at 6:43 AM, TaiJu Wu wrote: >> Thanks for this KIP, >> >> +1(non-binding) >> >> Best, >> TaiJuWu >> >> On Thu, Apr 3, 2025 at 9:42 PM Kuan Po Tsen

[jira] [Created] (KAFKA-19031) Ensure brokers do not return null records in ShareFetchResponse

Andrew Schofield created KAFKA-19031: Summary: Ensure brokers do not return null records in ShareFetchResponse Key: KAFKA-19031 URL: https://issues.apache.org/jira/browse/KAFKA-19031 Project: Kafk

KRaft controller disaster recovery

Consider the following Kafka controller setup. There are three controllers c1, c2 and c3, each on its own hardware. All controllers are voters and let’s assume c1 is the leader. Assume new servers can be added as needed to replace broken one, but broken/lost servers cannot be brought back. If a new

[PR] MINOR: Small edits for 4.0 [kafka-site]

dajac opened a new pull request, #674: URL: https://github.com/apache/kafka-site/pull/674 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

[jira] [Created] (KAFKA-19060) Documented null edge cases in the Clients API JavaDoc

黃竣陽 created KAFKA-19060: --- Summary: Documented null edge cases in the Clients API JavaDoc Key: KAFKA-19060 URL: https://issues.apache.org/jira/browse/KAFKA-19060 Project: Kafka Issue Type: Improvement

Re: kafka 4.0.0 running on java 11

Hi Max, Please check the Notable changes in 4.0.0 . The minimal Java version for Kafka Stream is 11. For brokers, connect, and tools, they require Java 17. You can also check KIP-750

[jira] [Created] (KAFKA-19013) Pre-format PR body for merge queue

David Arthur created KAFKA-19013: Summary: Pre-format PR body for merge queue Key: KAFKA-19013 URL: https://issues.apache.org/jira/browse/KAFKA-19013 Project: Kafka Issue Type: Sub-task

Re: [kafka-clients] [ANNOUNCE] Apache Kafka 4.0.0

Amazing release!! Thanks to all the contributors, and to David(as RM) for running the release. On Tue, 18 Mar 2025 at 21:13, David Jacot wrote: > > The Apache Kafka community is pleased to announce the release for > Apache Kafka 4.0.0 > > - This is the first release without Apache Zookeeper > - T

Re: KRaft controller disaster recovery

Hi Juha, Thanks for bringing this. I agree having a way to recover from this "majority of controller nodes down" issue is valuable, even though this is rare. In addition to the approaches you provided, maybe we can have a way to "force" KRaft to honor "controller.quorum.voters" config, instead of

[PR] Update 4.0 blog [kafka-site]

dajac opened a new pull request, #675: URL: https://github.com/apache/kafka-site/pull/675 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mai

[jira] [Created] (KAFKA-19077) Propagate shutdownRequested field

Lucas Brutschy created KAFKA-19077: -- Summary: Propagate shutdownRequested field Key: KAFKA-19077 URL: https://issues.apache.org/jira/browse/KAFKA-19077 Project: Kafka Issue Type: Sub-task

[jira] [Resolved] (KAFKA-19018) Send acquisition time in Share Fetch Response

[ https://issues.apache.org/jira/browse/KAFKA-19018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19018. -- Resolution: Fixed > Send acquisition time in Share Fetch Response > --

Re: [VOTE] KIP-1133: AK Documentation and Website in Markdown

+1 (non-binding) On Thu, Apr 3, 2025, at 6:43 AM, TaiJu Wu wrote: > Thanks for this KIP, > > +1(non-binding) > > Best, > TaiJuWu > > On Thu, Apr 3, 2025 at 9:42 PM Kuan Po Tseng wrote: > > > Hi Harish, > > > > Thank you for improving the documentation! > > > > +1 (non-binding) > > > > Best, >

Re: [VOTE] KIP-1064 - Upgrade slf4j to 2.x

hi Clayton Thanks for your suggestion. IIRC, System.Logger is primarily used within the JDK itself, and therefore lacks extensive APIs. Additionally, I am uncertain whether all SLF4J providers support System.Logger. If they do not, it will present a significant issue, given our long-standing use

[jira] [Created] (KAFKA-19032) Remove TestInfoUtils.TestWithParameterizedQuorumAndGroupProtocolNames

PoAn Yang created KAFKA-19032: - Summary: Remove TestInfoUtils.TestWithParameterizedQuorumAndGroupProtocolNames Key: KAFKA-19032 URL: https://issues.apache.org/jira/browse/KAFKA-19032 Project: Kafka

Re: [VOTE] KIP-1123: Rack-aware partitioning for Kafka Producer

+1 non binding On Mon, Mar 24, 2025 at 9:51 AM Frédérik Rouleau wrote: > > +1 (non-binding) > > On Sat, Mar 22, 2025 at 12:32 PM Ivan Yurchenko wrote: > > > Hi! > > > > As there's no more comments regarding KIP-1123 [1], I'd like to put it to > > a vote. > > > > Best regards, > > Ivan > > > > [1

Re: [DISCUSS] KIP-1152: Add transactional ID prefix filter to ListTransactions API

Hi Chia-Ping, Sure, I updated the field to be nullable. Thanks On Fri, Apr 4, 2025 at 9:54 PM Chia-Ping Tsai wrote: > > Do you mean the TransactionalIdPatternFilter in the ListTransaction > request > can be nullable? > > Yes, and the null means “all transaction ids” > > Best, > Chia-Ping > > > >

[jira] [Created] (KAFKA-19095) enhance the docs of incrementalAlterConfigs to remind that controller only apply the cluster-level dynamic configurations

Chia-Ping Tsai created KAFKA-19095: -- Summary: enhance the docs of incrementalAlterConfigs to remind that controller only apply the cluster-level dynamic configurations Key: KAFKA-19095 URL: https://issues.apache.

[jira] [Created] (KAFKA-19094) Add a mechanism to GroupMetadataManager for handling static members leaving groups

TengYao Chi created KAFKA-19094: --- Summary: Add a mechanism to GroupMetadataManager for handling static members leaving groups Key: KAFKA-19094 URL: https://issues.apache.org/jira/browse/KAFKA-19094 Proj

[jira] [Created] (KAFKA-19093) Change the "Handler on Broker" to "Handler on Controller" for controller server

Chia-Ping Tsai created KAFKA-19093: -- Summary: Change the "Handler on Broker" to "Handler on Controller" for controller server Key: KAFKA-19093 URL: https://issues.apache.org/jira/browse/KAFKA-19093

[jira] [Resolved] (KAFKA-19074) Remove the cached responseData from ShareFetchResponse

[ https://issues.apache.org/jira/browse/KAFKA-19074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-19074. Fix Version/s: 4.1.0 Resolution: Fixed > Remove the cached responseData from ShareF

Re: [DISCUSS] KIP-1136: Make ConsumerGroupMetadata an interface

Hi Kirk PR with making constructors deprecated since 4.1.0 is ready to merge -> https://github.com/apache/kafka/pull/18977. wt., 25 mar 2025 o 01:24 Kirk True napisał(a): > Hi Paweł, > > We can't change the existing (public) constructors to private in 4.1 as > that would break users. Yes, we ca

Re: [DISCUSS] KIP-1136: Make ConsumerGroupMetadata an interface

Thanks for the pointer. It seems the example would require to make the constructor of `ConsumerGroupMetadata` package private though? If it's `private` as in the example, `retyrb kafkaConsumer.groupMetadata()` would not be able to return an instance, as the object is created inside `KafkaConsu