Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

The difference I see for EOS as the following: We have a different cut-off version. Instead of 2.3 (or earlier) like we have for eager/cooperative, also 2.4 and 2.5 require the bridge release upgrade to 3.9, to transit the app from EOSv1 to EOSv2. A 2.5 (or earlier) apps with EOSv1 enabled, c

[jira] [Resolved] (KAFKA-18850) Fix the docs of org.apache.kafka.automatic.config.providers

[ https://issues.apache.org/jira/browse/KAFKA-18850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18850. Resolution: Fixed trunk: [https://github.com/apache/kafka/commit/dd85938661b7b84640941dac

[DISCUSS] KIP-1138: Clean up TopologyConfig and API for supplying configs needed by the topology

Hi Everyone, I would like to start a discussion on KIP-1138: Clean up TopologyConfig and API for supplying configs needed by the topology This proposal aim

[jira] [Created] (KAFKA-18879) Formatter for share group specific records in __consumer_offsets

Sushant Mahajan created KAFKA-18879: --- Summary: Formatter for share group specific records in __consumer_offsets Key: KAFKA-18879 URL: https://issues.apache.org/jira/browse/KAFKA-18879 Project: Kafka

Re: [VOTE] KIP-1127: Flexible Windows for Late Arriving Data

Hi All, KIP-1127 has been accepted with 3 binding votes (Sophie, Lucas, Matthias). Voting is now closed -- thanks everyone! Cheers, Almog On Mon, Feb 24, 2025 at 6:51 PM Matthias J. Sax wrote: > +1 (binding) > > On 2/18/25 8:58 AM, Lucas Brutschy wrote: > > +1 (binding) > > > > Thanks for the

Re: New PR workflow in KAFKA-18748

Sophie, > are tests automatically sorted into these buckets or do we have to manually move them This part hasn't changed -- we still need to manually mark tests as @Flaky when they are flaky. The recent change has just separated out the flaky tests into a parallel job rather than a sequential ste

Re: [VOTE] 4.0.0 RC0

Thanks for the clarification Jose. Makes sense. Ismael On Wed, Feb 26, 2025 at 9:22 AM José Armando García Sancio wrote: > Hi Ismael, > > On Wed, Feb 26, 2025 at 7:51 AM Ismael Juma wrote: > > > > Hi Jose, > > > > Is it a low risk change? If not, I would suggest giving it a bit of > > stabiliz

Re: [VOTE] 4.0.0 RC0

Hi Jose, Is it a low risk change? If not, I would suggest giving it a bit of stabilization time before cherry-picking to older branches including 4.0 and 3.9. I don't think it's necessary to backport to other older branches given that it's not a regression and I don't believe there are any cases o

[jira] [Created] (KAFKA-18873) Incorrect error message for max.in.flight.requests.per.connection when using transactional producer.

Eslam Mohamed created KAFKA-18873: - Summary: Incorrect error message for max.in.flight.requests.per.connection when using transactional producer. Key: KAFKA-18873 URL: https://issues.apache.org/jira/browse/KAFKA-1

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

Hi Matthias, I appreciate your feedback; it really helped me a lot! Regarding the issue of upgrading streams from a very old version to 4.x, I understand that streams are much more complicated than Kafka Client. I think it's reasonable to do two bumps, but I'm not a Kafka Streams expert, and I wou

Re: [DISCUSS] KIP-1124: Providing a clear Kafka Client upgrade path

I personally think we should just recommend 3.9 as the sole bridge release, and not include 2.8. Major versions are about API compatibility, there shouldn't be any inherent risk in upgrading more than one major release at a time. Things are already complicated enough :) I do agree that we should j

[jira] [Resolved] (KAFKA-18863) Runtime additions for connector multiversioning.

[ https://issues.apache.org/jira/browse/KAFKA-18863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Harris resolved KAFKA-18863. - Fix Version/s: 4.1.0 Resolution: Fixed > Runtime additions for connector multiversioning.

[jira] [Created] (KAFKA-18878) Implement share session cache metrics for share fetch

Apoorv Mittal created KAFKA-18878: - Summary: Implement share session cache metrics for share fetch Key: KAFKA-18878 URL: https://issues.apache.org/jira/browse/KAFKA-18878 Project: Kafka Issue

Re: kafka producer exception due to TimeoutException:

Hi Giri, The first question I would ask is: what happens when you run the producer with the default configuration? Producer timeouts are usually caused by client misconfiguration, network issues, broker load/topology changes, or a combination of those. Try to remove as many configuration overr

Re: [DISCUSS] KIP-1136: Make ConsumerGroupMetadata an interface

Hi Paweł, Thanks for the KIP! My questions: KT1. What will prevent developers from implementing their own ConsumerGroupMetadata and passing that to sendOffsetsToTransaction()? I assume the code will check the incoming object is of type DefaultConsumerGroupMetadata? KT2. To me, the use of the

Re: [VOTE] 4.0.0 RC0

hi David I apologize for not testing the release candidate (RC) as I focused on reviewing the documentation. I have created tickets to address issues in the documentation [0][1][2][3], which will be merged into 4.0 as the risk is minimal. Please let me know if you have any other options for th

[jira] [Resolved] (KAFKA-18875) KRaft controller does not retry registration if the first attempt times out

[ https://issues.apache.org/jira/browse/KAFKA-18875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] TaiJuWu resolved KAFKA-18875. - Resolution: Duplicate > KRaft controller does not retry registration if the first attempt times out > --

[jira] [Resolved] (KAFKA-18869) add remote storage threads to "Updating Thread Configs" section

[ https://issues.apache.org/jira/browse/KAFKA-18869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-18869. Resolution: Fixed trunk: [https://github.com/apache/kafka/commit/8bbca913efe260ba59c82480

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #222

See

[jira] [Created] (KAFKA-18874) KRaft controller does not retry registration if the first attempt times out

Daniel Fonai created KAFKA-18874: Summary: KRaft controller does not retry registration if the first attempt times out Key: KAFKA-18874 URL: https://issues.apache.org/jira/browse/KAFKA-18874 Project:

Re: [VOTE] 4.0.0 RC0

Hi Ismael, On Wed, Feb 26, 2025 at 7:51 AM Ismael Juma wrote: > > Hi Jose, > > Is it a low risk change? If not, I would suggest giving it a bit of > stabilization time before cherry-picking to older branches including 4.0 > and 3.9. I don't think it's necessary to backport to other older branches

Re: New PR workflow in KAFKA-18748

Another thing that changed this week is the addition of a PR Linter. This is part of the merge queue effort. With merge queues, we cannot alter the commit message like we do with the merge button. Instead the commit message comes from the PR title and PR body. A script for validating the PR title+

Re: Support for other OAuth2 grant types in Kafka

Hi Subra, I'm one of the authors of the OAuth support in Kafka. Answers to your questions are below... On Tue, Feb 25, 2025, at 3:05 AM, Subra I wrote: > Hello All, > > I see that Kafka by itself supports client credentials as grant type for > OAuth2. I see this mentioned in one of the kafka KI

[jira] [Created] (KAFKA-18875) KRaft controller does not retry registration if the first attempt times out

Daniel Fonai created KAFKA-18875: Summary: KRaft controller does not retry registration if the first attempt times out Key: KAFKA-18875 URL: https://issues.apache.org/jira/browse/KAFKA-18875 Project:

[jira] [Created] (KAFKA-18876) 4.0 documentation improvement

Jun Rao created KAFKA-18876: --- Summary: 4.0 documentation improvement Key: KAFKA-18876 URL: https://issues.apache.org/jira/browse/KAFKA-18876 Project: Kafka Issue Type: Improvement Affects Versi

[jira] [Created] (KAFKA-18877) an mechanism to find cases where we accessed variables from the wrong thread

Chia-Ping Tsai created KAFKA-18877: -- Summary: an mechanism to find cases where we accessed variables from the wrong thread Key: KAFKA-18877 URL: https://issues.apache.org/jira/browse/KAFKA-18877 Proj

Re: [VOTE] 4.0.0 RC0

Hi David, Thanks for running the release. I performed the following steps: * Built from source using Java 17 * Enabled KIP-932 and ran through some basic actions to make sure it worked based on https://cwiki.apache.org/confluence/display/KAFKA/Queues+for+Kafka+%28KIP-932%29+-+Early+Access+Releas

[jira] [Created] (KAFKA-18871) KRaft migration rollback causes downtime

Daniel Urban created KAFKA-18871: Summary: KRaft migration rollback causes downtime Key: KAFKA-18871 URL: https://issues.apache.org/jira/browse/KAFKA-18871 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-18866) JDK23: UnsupportedOperationException: getSubject is supported only if a security manager is allowed

Christian Habermehl created KAFKA-18866: --- Summary: JDK23: UnsupportedOperationException: getSubject is supported only if a security manager is allowed Key: KAFKA-18866 URL: https://issues.apache.org/jira/bro

[jira] [Created] (KAFKA-18867) add tests to describe topic configs with empty name

Chia-Ping Tsai created KAFKA-18867: -- Summary: add tests to describe topic configs with empty name Key: KAFKA-18867 URL: https://issues.apache.org/jira/browse/KAFKA-18867 Project: Kafka Issue

[jira] [Created] (KAFKA-18869) add remote storage threads to "Updating Thread Configs" section

Chia-Ping Tsai created KAFKA-18869: -- Summary: add remote storage threads to "Updating Thread Configs" section Key: KAFKA-18869 URL: https://issues.apache.org/jira/browse/KAFKA-18869 Project: Kafka

[jira] [Created] (KAFKA-18868) add the "default value" explanation to the docs of num.replica.alter.log.dirs.threads

Chia-Ping Tsai created KAFKA-18868: -- Summary: add the "default value" explanation to the docs of num.replica.alter.log.dirs.threads Key: KAFKA-18868 URL: https://issues.apache.org/jira/browse/KAFKA-18868

[jira] [Created] (KAFKA-18870) implement describeDelegationToken for controller

Chia-Ping Tsai created KAFKA-18870: -- Summary: implement describeDelegationToken for controller Key: KAFKA-18870 URL: https://issues.apache.org/jira/browse/KAFKA-18870 Project: Kafka Issue Ty

[jira] [Created] (KAFKA-18872) Convert StressTestLog and TestLinearWriteSpeed to jmh benchmarks

Mickael Maison created KAFKA-18872: -- Summary: Convert StressTestLog and TestLinearWriteSpeed to jmh benchmarks Key: KAFKA-18872 URL: https://issues.apache.org/jira/browse/KAFKA-18872 Project: Kafka

[jira] [Resolved] (KAFKA-18757) Create full-function SimpleAssignor to match KIP-932 description

[ https://issues.apache.org/jira/browse/KAFKA-18757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhinav Dixit resolved KAFKA-18757. --- Fix Version/s: 4.1.0 Resolution: Fixed > Create full-function SimpleAssignor to match