Re: [VOTE] 3.9.1 RC1

> I was "lazy" and tried to use the top level quickstart which did not > work -- I assumed that the 4.0 quickstart which also work with 3.9? > Maybe I am wrong? The way the files are structured under https://github.com/apache/kafka-site/ makes it so that the top level quickstart refers always to t

Re: [VOTE] 3.9.1 RC1

This behavior tripped me up a couple of times, I was on a specific documentation version and without realizing I navigated to the "top level" and went back to the latest version docs On Mon, May 12, 2025 at 10:19 AM Josep Prat wrote: > > I was "lazy" and tried to use the top level quickstart whi

[VOTE] 3.9.1 RC2

Hello Kafka users, developers and client-developers, This is the third candidate for the release of Apache Kafka 3.9.1. This RC fixed the LICENSE-binary misalignment issue and also bump the jetty version for CVE-2024-13009 compared with RC1. This is a bug-fix release with several fixes, and most

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #199

See

Re: [DISCUSS] KIP-1176: Tiered Storage for Active Log Segment

Hi Henry, > Thanks for the detailed response again. I added a section: https://cwiki.apache.org/confluence/display/KAFKA/KIP-1176%3A+Tiered+Storage+for+Active+Log+Segment#KIP1176:TieredStorageforActiveLogSegment-ComparisontoKIP-405:TieredStorage to compare this KIP and KIP-405 for some of the poi

[jira] [Resolved] (KAFKA-19051) Fix implicit acknowledgement cannot be overridden when RecordDeserializationException occurs

[ https://issues.apache.org/jira/browse/KAFKA-19051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Schofield resolved KAFKA-19051. -- Resolution: Won't Fix Reviewing this issue, it is clear that the behaviour suggested i

Re: [VOTE] KIP-1136: Make ConsumerGroupMetadata an interface

Hi David Sure I updated KIP with new terminology. pt., 9 maj 2025 o 11:22 David Jacot napisał(a): > Hi Pawel, > > Thanks for the KIP and sorry for my late comment but I somehow missed the > discussion thread about it. > > I have one minor ask: Could we change `generationId` to `memberEpoch` i

[DISCUSS] KIP-1179: Introduce remote.log.manager.follower.thread.pool.size config

Hello everyone, I’d like to discuss a KIP regarding introducing a new configuration, remote.log.manager.follower.thread.pool.size Thank you! KIP link: https://cwiki.apache.org/confluence/x/xAlWFQ Best, Kuan-Po Tseng

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hi, Thanks for the KIP. One weirdness of cleanup.policy is that you can set it to "delete,delete,delete,compact,compact" for example. Setting delete or compact multiple times has no functional impact. I don't think it's something that has to be addressed, but while you're looking at the configura

[jira] [Created] (KAFKA-19271) Private interface for injecting test wrappers for KIP-1071 enabled consumers

Lucas Brutschy created KAFKA-19271: -- Summary: Private interface for injecting test wrappers for KIP-1071 enabled consumers Key: KAFKA-19271 URL: https://issues.apache.org/jira/browse/KAFKA-19271 Proj

Re: [DISCUSS] KIP-1180: Add a generic feature level metric

Hey Chia-Ping and Justine, Okay, that makes sense about the minimum version changing at some point. I'll add these metrics to this KIP. Thanks for the insightful discussion. Best, Kevin Wu On Fri, May 9, 2025 at 4:54 PM Kevin Wu wrote: > Hey Chia-Ping and Justine, > > Thanks for the explanatio

[jira] [Resolved] (KAFKA-19242) Fix commit bugs caused by race condition during rebalancing.

[ https://issues.apache.org/jira/browse/KAFKA-19242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-19242. - Fix Version/s: 3.9.2 4.0.1 4.1.0 Resolution: Fixed

[jira] [Resolved] (KAFKA-19164) New group coordinator won't delete groups with previously pending transactional offsets that were deleted

[ https://issues.apache.org/jira/browse/KAFKA-19164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-19164. - Fix Version/s: 4.0.1 4.1.0 Resolution: Fixed > New group coordinator w

[jira] [Resolved] (KAFKA-19160) Fetching stable offsets is very slow with a large number of partition and open transactions

[ https://issues.apache.org/jira/browse/KAFKA-19160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-19160. - Fix Version/s: 4.0.1 4.1.0 Resolution: Fixed > Fetching stable offsets

[jira] [Created] (KAFKA-19272) Handling different scenarios for initPid(keepPrepared=true)

Ritika Reddy created KAFKA-19272: Summary: Handling different scenarios for initPid(keepPrepared=true) Key: KAFKA-19272 URL: https://issues.apache.org/jira/browse/KAFKA-19272 Project: Kafka

KIP-1182 Quality of Service (QoS) for Apache Kafka

David Kjerrumgaard and I wrote up the following KIP for Kafka Quality of Service (QoS). It would be a mechanism to describe desired behaviors and actual capabilities of producers, clusters and consumers, and to allow them to negotiate desired throughputs, latencies, data retention, and other elemen

Re: [DISCUSS] KIP-1180: Add a generic feature level metric

Hi, Kevin, Thanks for the updated KIP. A couple of more comments. 4. Should we expose the FinalizedLevel metric on the controller too? 5. Some of the metric names are camel case and some others use dash. It would be useful to be consistent. Jun On Mon, May 12, 2025 at 7:06 AM Kevin Wu wrote:

Re: [VOTE] KIP-1136: Make ConsumerGroupMetadata an interface

+1 (binding) -Matthias On 5/12/25 11:15 AM, Paweł Szymczyk wrote: Hi David Sure I updated KIP with new terminology. pt., 9 maj 2025 o 11:22 David Jacot napisał(a): Hi Pawel, Thanks for the KIP and sorry for my late comment but I somehow missed the discussion thread about it. I have on

Re: [VOTE] 3.9.1 RC2

Hi, I tried to run unit tests on the source, but could not get `SocketServerTest` to pass. Anybody has any idea? Tried to re-run a few times... ./gradlew :core:unitTest --tests kafka.network.SocketServerTest Getting java.lang.IllegalStateException: Channel closed too early and java.la

Re: [VOTE] 3.9.1 RC2

Hi Matthias, Are you running these tests on macOS? I’ve observed the same issue, but the tests pass on Linux (openSUSE Tumbleweed). I suspect this issue is specific to the macOS environment. The related issue can be found here: KAFKA-16701 . -K

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hi, Luke, Regarding the motivation, currently, we never documented that an empty cleanup.policy implies infinite retention. In fact, if one leaves cleanup.policy empty, it actually breaks remote storage since it will stop the cleaning based on local retention size and time too. So, leaving cleanup

[jira] [Resolved] (KAFKA-13224) broker.id does not appear in config's originals map when setting just node.id

[ https://issues.apache.org/jira/browse/KAFKA-13224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-13224. Fix Version/s: 3.1.0 Assignee: Colin McCabe (was: Ron Dagostino) Resolutio

[jira] [Resolved] (KAFKA-13192) broker.id and node.id can be specified inconsistently

[ https://issues.apache.org/jira/browse/KAFKA-13192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-13192. Resolution: Won't Fix see KAFKA-13224 > broker.id and node.id can be specified inconsiste

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

hi all, Given Luke mentioned the existence of use cases, it is worth considering the compatibility issue. In fact, I had previously encountered this use case but advised customers to utilize retention configurations instead. > We could also consider supporting an empty cleanup.policy by fixing

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hi Jun, > Regarding the motivation, currently, we never documented that an empty cleanup.policy implies infinite retention. In fact, if one leaves cleanup.policy empty, it actually breaks remote storage since it will stop the cleaning based on local retention size and time too. So, leaving cleanup

[jira] [Created] (KAFKA-19269) "Unexpected error .." should not happen when the delete.topic.enable is false

Chia-Ping Tsai created KAFKA-19269: -- Summary: "Unexpected error .." should not happen when the delete.topic.enable is false Key: KAFKA-19269 URL: https://issues.apache.org/jira/browse/KAFKA-19269 Pro

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.9 #200

See

Re: [DISCUSS] KIP-1161: cleanup.policy shouldn't be empty

Hi Luke, Chia, Thanks for your information. >> FYI, there are indeed use cases that need to keep all history data without >> a cleanup policy. I agree that we should maintain backward compatibility. Therefore, I will update the KIP as follows: - If the user sets an empty cleanup.policy, we wil

[jira] [Created] (KAFKA-19270) Remove optional from ClusterInstance#controllerListenerName

Chia-Ping Tsai created KAFKA-19270: -- Summary: Remove optional from ClusterInstance#controllerListenerName Key: KAFKA-19270 URL: https://issues.apache.org/jira/browse/KAFKA-19270 Project: Kafka

[jira] [Created] (KAFKA-19268) Missing mocks for SharePartitionManagerTest tests

Abhinav Dixit created KAFKA-19268: - Summary: Missing mocks for SharePartitionManagerTest tests Key: KAFKA-19268 URL: https://issues.apache.org/jira/browse/KAFKA-19268 Project: Kafka Issue Typ

[jira] [Created] (KAFKA-19273) Ensure the delete policy is configured when the tiered storage is enabled

Chia-Ping Tsai created KAFKA-19273: -- Summary: Ensure the delete policy is configured when the tiered storage is enabled Key: KAFKA-19273 URL: https://issues.apache.org/jira/browse/KAFKA-19273 Project

Jenkins build is still unstable: Kafka » Kafka PowerPC Daily » test-powerpc #296

See

[jira] [Created] (KAFKA-19274) Group Coordinator Shards are not unloaded when __consumer_offsets topic is deleted

David Jacot created KAFKA-19274: --- Summary: Group Coordinator Shards are not unloaded when __consumer_offsets topic is deleted Key: KAFKA-19274 URL: https://issues.apache.org/jira/browse/KAFKA-19274 Proj